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Abstract 

The  Vehicle  Dynamics  Monitoring  and  Tracking  System  (VDMTS)  has 
three  components:  (l)  vehicle  impact  models,  (2)  vehicle-tracking 
hardware  and  software,  and  (3)  vehicle-tracking  stat  analysis.  The  vehicle¬ 
tracking  approach  was  used  to  predict  impacts  associated  with  military 
and  vehicle  maneuver  training.  These  dynamic  characteristics  are  used  to 
predict  area  impacted,  vegetation  loss,  and  rut  depth  based  on  vehicle  type 
and  location.  These  results  are  then  summarized  to  characterize  training 
land-use  patterns  and  quantify  the  severity  of  the  training  impacts.  This 
demonstration/validation  project  tested  and  validated  each  aspect  of  the 
VDMTS  process.  In  multiple  levels,  it  tested  and  demonstrated  the 
accuracy  of  the  hardware  and  models  in  combination,  the  durability  of  the 
hardware  under  multiple  training  events,  the  ease  of  use  of  the  VDMTS 
process,  and  the  ability  to  make  land-use  decisions  based  on  the  VDMTS 
collected  and  summarized  data.  The  document  provides  the  lessons 
learned  from  the  demonstration  and  provides  information  on 
implementation  strategies  and  options. 


DISCLAIMER:  The  contents  of  this  report  are  not  to  be  used  for  advertising,  publication,  or  promotional  purposes. 
Citation  of  trade  names  does  not  constitute  an  official  endorsement  or  approval  of  the  use  of  such  commercial  products. 
All  product  names  and  trademarks  cited  are  the  property  of  their  respective  owners.  The  findings  of  this  report  are  not  to 
be  construed  as  an  official  Department  of  the  Army  position  unless  so  designated  by  other  authorized  documents. 
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Executive  Summary 

The  use  of  military  vehicles  during  training  results  in  soil  disturbance  and 
vegetation  loss,  with  subsequent  increases  in  soil  erosion  rates,  sedimenta¬ 
tion  in  streams,  habitat  degradation,  and  numerous  other  secondary  ef¬ 
fects.  The  National  Environmental  Policy  Act  (NEPA)  requires  Federal 
agencies  to  evaluate  the  implications  of  their  plans,  policies,  programs, 
and  projects.  However,  accurate  assessment  of  military  training  impacts  is 
limited  by  the  technical  data  available  to  support  the  assessments.  This 
project  demonstrated  the  use  of  the  Vehicle  Dynamics  Monitoring  and 
Tracking  System  (VDMTS)  to  assess  and  predict  military  vehicle  maneuver 
training  impacts  for  use  in  land  management  decisionmaking  and  NEPA 
documentation.  The  VDMTS  approach  is  composed  of  three  components: 
(l)  vehicle  impact  models,  (2)  vehicle-tracking  hardware  and  software,  and 
(3)  vehicle-tracking  data  analysis.  The  approach  spatially  characterizes 
short-term,  direct  impacts  by  monitoring  individual  vehicle  locations  and 
operating  characteristics.  These  dynamic  characteristics  are  used  to  pre¬ 
dict  area  impacted,  vegetation  loss,  and  rut  depth  based  on  vehicle  type 
and  location. 

This  demonstration/ validation  project  tested  and  validated  each  aspect  of 
the  VDMTS  process  at  multiple  levels,  specifically:  accuracy  of  the  hard¬ 
ware  and  models  in  combination;  durability  of  the  hardware  under  multi¬ 
ple  training  events;  ease  of  use  of  the  VDMTS  process;  and  ability  to  make 
land-use  decisions  based  on  the  VDMTS  collected  and  summarized  data. 
The  following  quantitative  metrics  were  tested  to  assess  each  aspect  of 
VDMTS  performance:  (1)  accurate  VDMTS  hardware  measurement  of  ve¬ 
hicle  dynamic  properties,  (2)  accurate  VDMTS  impact  model  predictions 
of  site  impacts  under  controlled  conditions,  (3)  accurate  VDMTS  hardware 
measurement  of  vehicle  static  and  dynamic  properties,  (4)  accurate 
VDMTS  model  predictions  of  site  impacts  during  live  training,  (5)  VDMTS 
hardware  durability  (in  single  live  training  event),  (6)  VDMTS  Hardware 
durability  over  14  live  training  events,  (7)  ease  of  system  use,  and 
(8)  quality  and  accuracy  of  data  for  land-use  decisions. 

The  following  hardware  performance  metrics  (described  above)  were  met: 
1,  3,  and  5-8.  Metrics  2  and  4  (accurate  VDMTS  impact  models  predictions 
in  controlled  and  live  events)  did  not  meet  the  success  criteria  initially 
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proposed.  The  demonstrated  average  error  for  disturbed  width  was  14.9 
cm  and  the  average  error  for  vegetation  removal  was  -1.8%.  These  results 
are  comparable  with  existing  site  and  vehicle-specific  empirical  model 
predictions,  thus  reducing  the  need  to  develop  models  for  each  site.  This 
validates  the  use  of  the  theoretical  models  for  impact  prediction. 

Overall,  the  demonstration  and  validation  project  confirmed  that  a  need 
exists  for  a  system  that  can  produce  data  and  analyses  like  the  VDMTS. 
The  system  met  most  of  the  metrics  established.  While  it  failed  to  meet 
some  metrics,  it  still  performed  as  well  as  previous  methods  in  characteriz¬ 
ing  vehicle  impacts,  reducing  the  relative  cost  and  time  required. 

This  work  was  undertaken  to  assist  installations  in  making  informed  deci¬ 
sions  regarding  technology  implementation  and  associated  costs.  The  re¬ 
sulting  technology  is  valuable  in  obtaining  data  to  estimate  impacts  from 
military  training.  Through  the  course  of  the  project,  installation  Integrated 
Training  Area  Management  (IT AM),  Environmental,  Directorate  of  Public 
Works  (DPW),  and  training  groups  used  results  obtained  from  this  study. 
Data  collected  were  used  in  land  management  and  vehicle  mobility  and 
power  models.  Study  results  also  informed  training  and  regulating  deci¬ 


sions. 
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1  Introduction 

1.1  Background 

The  Vehicle  Dynamics  Monitoring  and  Tracking  System  (VDMTS)  consists 
of  three  components:  (l)  vehicle  impact  models,  (2)  vehicle-tracking 
hardware  and  software,  and  (3)  vehicle-tracking  data  analysis. 

The  VDMTS  approach  was  developed  to  predict  impacts  associated  with 
vehicle-based  training.  The  approach  spatially  characterizes  short-term, 
direct  impacts  resulting  from  vehicles  by  monitoring  individual  vehicle  lo¬ 
cations  and  operating  characteristics  (e.g.,  turning  radius  and  velocity). 
Vehicle  impact  models  are  used  to  predict  area  impacted,  vegetation  loss, 
and  rut  depth,  and  are  based  on  vehicle-operating  characteristics  and  loca¬ 
tion.  Analysis  routines  are  used  to  summarize  use  patterns  and  the  severity 
of  cumulative  impacts. 

The  vehicle  impact  models  are  theoretical,  process-based  vehicle  impact 
models  used  to  predict  site  impacts  in  terms  of  disturbed  area,  vegetation 
loss,  and  rut  depth.  Process-based  impact  models  predict  severity  of  im¬ 
pact  based  on  vehicle  static  properties  (e.g.,  vehicle  type,  weight,  dimen¬ 
sion),  vehicle  dynamic  properties  (e.g.,  turning  radius,  velocity),  and  site 
conditions  (e.g.,  soil  strength).  Data  collected  by  the  VDMTS  hardware  are 
used  with  the  impact  models  to  predict  spatially  explicit  site  impacts. 

The  vehicle-tracking  hardware  and  software  measure  vehicle  kinematics, 
dynamics,  and  other  parameters  of  interest.  This  enables  accurate  model¬ 
ing  of  environmental  impacts.  Innovative  sensor  fusion  software  combines 
data  from  these  sensors  to  provide  position  information  even  during  global 
positioning  system  (GPS)  outage.  The  system  thereby  provides  vehicle  dy¬ 
namics  data  and  positional  information  at  all  times,  even  when  GPS  is  un¬ 
available.  The  VDMTS  has  the  capability  to  record  the  vehicle  dynamics 
tagged  with  position  information  for  post-mission  analysis.  Vehicle¬ 
tracking  visualization  software  resides  on  a  user’s  desktop  that  provides 
simple  visual  access  to  the  VDMTS  data  within  a  geographic  information 
system  (GIS)  environment. 
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Vehicle-tracking  data  analysis  routines  summarize  vehicle-tracking  data  in 
a  manner  compatible  within  typical  installation  decisionmaking  processes. 
Analysis  routines  include  spatial  displays  of  estimated  vegetation  loss  and 
soil  rutting,  percent  of  vegetation  lost  within  management  areas,  percent 
on  and  off-road  traffic,  potential  trail  identification,  training  patterns,  and 
vehicle  training  in  proximity  to  Threatened  and  Endangered  Species  (TES) 
habitat. 

NEPA  requires  Federal  agencies  to  evaluate  the  environmental  implica¬ 
tions  of  their  plans,  policies,  programs,  and  projects  —  at  the  same  time 
that  traditional  economic  and  technical  evaluations  are  underway.  The  de¬ 
ployment  of  new  weapon  systems  or  operational  changes  in  training  re¬ 
quires  an  evaluation  of  potential  impacts  on  installation  natural  resources, 
and  the  evaluation  of  mitigations  to  alleviate  their  effects.  The  use  of  mili¬ 
tary  vehicles  during  training  results  in  soil  disturbance  and  vegetation  loss, 
with  subsequent  increases  in  soil  erosion  rates,  sedimentation  in  streams, 
habitat  degradation,  and  numerous  other  secondary  effects.  The  capacity 
of  installation  lands  to  support  training  activities  is  a  function  of  both  the 
sensitivity  of  lands  to  specific  activities  and  the  natural  recovery  rates  of 
vegetation.  However,  it  is  also  a  function  of  weapon  system  characteristics, 
the  doctrine  that  establishes  how  these  systems  are  used,  and  the  actual 
locations  where  activities  are  conducted.  Accurate  assessment  of  these  im¬ 
pacts  is  limited  by  the  technical  data  available  to  support  the  assessments. 

The  impact  of  off-road  vehicle  use  on  soil  and  vegetation  has  been  exten¬ 
sively  studied  (Demarais  et  al.  1999,  Anderson  et  al.  2005a).  However, 
multiple  factors  (Morrison-Saunders  and  Bailey  2003)  have  limited  the 
effective  use  of  this  information  in  environmental  impact  assessments. 
These  factors  include  vehicles  having  multiple  configurations,  assessments 
that  involve  multiple  vehicle  types,  and  a  lack  of  understand  of  how  and 
where  vehicle  are  used  in  the  natural  landscape.  For  example,  individual 
weapon  systems  are  often  fielded  in  more  than  one  configuration,  each 
with  unique  static  vehicle  properties.  Consider  that:  (1)  the  Stryker  vehicle 
comes  in  eight  configurations  varying  in  weight  from  28,000  lbs  to  41,000 
lbs,  (2)  new  weapon  systems  are  not  fielded  independently  of  other  vehi¬ 
cles,  and  (3)  multiple  vehicle  types  make  individual  military  units.  There¬ 
fore,  the  assessment  of  new  weapon  systems  or  relocation  of  existing  units 
requires  comparison  between  different  units,  each  made  up  of  varying  ve¬ 
hicle  types  and/or  configurations.  Information  sources  that  fail  to  account 
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for  these  factors  provide  limited  and  often  misleading  information  on  the 
range  of  impacts  associated  with  vehicle  training  activities. 

One  common  approach  to  assess  impacts  of  vehicles  has  been  to  measure 
historically  disturbed  and  undisturbed  sites  (Johnson  1982,  Shaw  and 
Diersing  1990,  Milchunas  et  al.  1999,  Milchunas  et  al.  2000,  Anderson  et 
al.  2005b).  While  these  studies  are  useful  for  quantifying  the  cumulative 
impact  of  vehicle  tracking  on  vegetation,  they  provide  little  quantitative 
information  that  relates  type  and  level  of  vehicle  use  to  the  amount  of  veg¬ 
etation  damage.  A  second  approach  to  assess  impacts  of  vehicles  has  been 
to  conduct  controlled  studies  quantifying  the  impact  of  specific  vehicles  at 
specified  levels  of  use  (Payne  et  al.  1983,  Wilson  1988,  Thurow  et  al.  1995, 
Prosser  et  al.  2000,  Grantham  et  al.  2001).  Typically,  these  replicated 
studies  involved  repeated  tracking  of  study  plots  with  a  specific  vehicle. 
However,  it  is  not  clear  if  the  dynamic  vehicle  properties  used  in  these 
studies  are  representative  of  actual  site  use  or  include  the  most  damaging 
vehicle  activities.  A  third  approach  to  assess  impacts  of  vehicles  is  to  use 
models  (Shaw  and  Diersing  1989,  Anderson  et  al.  1996,  Childress  et  al. 
2002)  to  predict  impacts.  These  capacity  models  require  input  data  on  the 
distribution  and  severity  of  vehicle  impacts.  Information  on  distribution 
and  severity  of  vehicle  impacts  is  generally  lacking. 

As  a  result  of  the  SERDP  project  “Improved  Units  of  Measure  for  Training 
and  Testing  Area  Carrying  Capacity  Estimation”  (Anderson  1999,  SERDP 
RC-1102),  and  the  Army  Small  Business  Innovative  Research  (SBIR)  pro¬ 
ject,  “Enhanced  GPS/INS  Tracking  and  Vehicle  Dynamics  Monitoring  Sys¬ 
tem,”  an  approach  and  tool  set  have  been  developed  to  collect  timely,  rele¬ 
vant,  and  consistent  vehicle  impact  data  to  effectively  support  NEPA  and 
other  land  management  requirements.  The  approach  addresses  the  spatial 
distribution  of  impacts,  severity  of  impact  for  most  military  vehicles,  and 
accounts  for  how  vehicles  are  used  during  training.  The  approach  uses  ve¬ 
hicle-tracking  systems  to  determine  vehicle  location  and  dynamic  operat¬ 
ing  characteristics  (e.g.,  turning  radius  and  velocity). 

Impacts  models  are  used  with  the  vehicle  data  to  predict  site  impacts.  Ve¬ 
hicles  are  initially  operated  through  defined  courses  to  establish  a  range  of 
vehicle  dynamic  operating  conditions.  Impacts  associated  with  vehicle  use 
are  measured  along  the  course,  and  models  are  developed  from  the  field 
data  to  predict  vehicle  impacts.  Vehicle-tracking  systems  are  used  to  track 
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vehicles  in  live  training  exercises.  Location  and  vehicle  property  infor¬ 
mation  are  used  with  the  impact  models  to  predict  the  cumulative  impact 
of  training  exercises.  The  approach  strengthens  the  scientific  basis  for 
NEPA  analyses,  leading  to  more  sustainable  Army  decisions. 

After  a  decision  to  field  weapon  systems  is  made  at  an  installation,  vehicle¬ 
tracking  systems  provide  both  a  new  capability  and  a  proactive  means  for 
the  installation  to  monitor  land  condition  and  preemptively  implement 
Land  Repair  and  Maintenance  (LRAM)  programs.  Traditional  methods  for 
site  evaluation  and  monitoring  based  on  permanent  field  plots  are  costly, 
time  consuming,  and  potentially  unreliable.  Current  DoD  Land  Condition 
Trend  Analysis  (LCTA)  programs  suffer  from  lag  times  between  field  data 
collection,  site  prioritization,  and  initiation  of  LRAM  projects.  The  direct 
monitoring  of  mission  impacts  allows  land  managers  to  locate  the  most 
severe  impacts  after  training  events  and  to  mitigate  initial  site  damage  be¬ 
fore  lands  further  degrade. 

A  demonstration  and  validation  project  was  required  to  assess  and  quanti¬ 
fy  the  overall  performance,  durability,  and  utility  of  the  proposed  system 
under  operational  field  conditions  to  address  a  range  of  DoD  land  man¬ 
agement  problems.  Land  management  applications  include:  (l)  develop¬ 
ment  of  data  for  carrying  capacity  models,  (2)  early  identification  of  trail 
formation,  (3)  identification  and  prioritization  of  LRAM  sites,  (4)  collec¬ 
tion  of  data  to  support  NEPA  processes,  (5)  characterization  of  training 
patterns  within  TES  habitat,  (6)  road  condition  assessment,  and  (7)  collec¬ 
tion  of  data  for  impact  analysis. 

1.2  Regulatory  drivers 

NEPA  requires  Federal  agencies  to  evaluate  the  environmental  implica¬ 
tions  of  their  plans,  policies,  programs,  and  projects,  at  the  same  time  that 
traditional  economic  and  technical  evaluations  are  underway.  NEPA  re¬ 
quires  that  an  Environmental  Impact  Statement  (EIS)  include  descriptions 
of  the  relationship  between  short-term  uses  of  the  environment  and 
maintenance  of  long-term  ecological  productivity.  For  military  weapon 
systems  and  training  activities,  EIS  require  descriptions  of  the  impact  of 
weapon  systems  and  training  on  installation  resources.  The  completion  of 
the  NEPA  process  often  results  in  agreement  by  the  DoD  to  monitor  im- 
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pacts  and  assess  EIS  assumptions.  The  proposed  VDMTS  approach  pro¬ 
vides  improved  methods  and  tools  to  meet  NEPA  requirements. 

The  Federal  Water  Pollution  Control  Act,  commonly  referred  to  as  the 
Clean  Water  Act  (CWA),  is  intended  to  restore  and  maintain  the  chemical, 
physical,  and  biological  integrity  of  the  nation’s  waters  by  preventing  point 
and  nonpoint  pollution  sources.  Nonpoint  source  (NPS)  pollution  comes 
from  many  diffuse  sources  like  military  lands.  NPS  pollution  is  caused  by 
rainfall  or  snowmelt  moving  over  and  through  the  ground.  As  the  runoff 
moves,  it  picks  up  and  carries  away  natural  and  human-made  pollutants, 
finally  depositing  them  into  the  nation’s  waters. 

Some  waters  in  the  nation  do  not  meet  the  CWA  national  goal  of  “fishable, 
swimmable”  despite  the  fact  that  nationally  required  levels  of  pollution 
control  technology  have  been  implemented  by  many  pollution  sources. 
CWA  Section  1313  addresses  waters  that  are  not  “fishable,  swimmable”  by 
requiring  states  to  identify  the  waters  and  to  develop  total  maximum  daily 
loads  (TMDLs)  for  them,  with  oversight  from  the  US  Environmental  Pro¬ 
tection  Agency  (40  CFR  130.7).  As  such,  TMDLs  play  a  key  role  in  water¬ 
shed  management. 

Each  state  identifies  waters  at  risk  and  establishes  TMDLs  to  protect  those 
waters.  This  includes  identifying  required  load  reductions  within  a  water¬ 
shed  from  agricultural,  military  and  other  nonpoint  sources.  These  load 
reductions  are  achieved  through  nonpoint  source  programs  established 
under  CWA  Section  319.  Soil  erosion  and  the  resulting  siltation  of  water¬ 
ways  has  long  been  a  major  concern  on  military  installations.  Off-road- 
vehicle-based  maneuver  training  is  a  major  contributor  to  accelerated  ero¬ 
sion  on  military  lands.  This  erosion  and  the  associated  sedimentation  of 
surrounding  waterways  can  be  in  violation  of  the  CWA.  It  has  been  previ¬ 
ously  estimated  that  the  cost  to  restore  damage  Army  lands  to  tolerable 
levels  of  soil  erosion  could  range  from  $iooM  to  $200M  per  year  for  up  to 
a  decade  (Warren  et  al.  2000). 

Section  7  of  the  Endangered  Species  Act  (ESA)  requires  Federal  agencies 
to  ensure  that  the  actions  they  take,  including  those  they  fund  or  author¬ 
ize,  do  not  jeopardize  the  existence  of  any  listed  species.  If  a  Federal  agen¬ 
cy  determines  that  an  action  may  adversely  affect  a  listed  species,  the 
agency  must  submit  to  US  Fish  and  Wildlife  Service  (USFWS)  a  request  for 
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consultation.  During  consultation,  the  USFWS  and  Federal  agency  share 
information  about  the  proposed  project  and  the  species  likely  to  be  affect¬ 
ed.  The  USFWS  provides  a  biological  opinion  on  whether  the  proposed  ac¬ 
tivity  jeopardizes  the  continued  existence  of  a  listed  species.  In  making  a 
determination  on  whether  an  action  results  in  a  jeopardy,  the  USFWS 
looks  at  the  current  status  of  the  species  (baseline).  The  USFWS  considers 
direct,  indirect,  interrelated,  interdependent,  and  cumulative  effects.  The 
burden  is  on  the  Federal  agency  to  fund  activities  related  to  ESA  including 
providing  data  for  the  USFWS  determination.  Thus,  if  a  Federal  agency 
action  is  important  (e.g.,  live  training),  the  motivation  is  for  the  Federal 
landowner  to  provide  data  to  support  their  position.  Direct/indirect/ other 
effects  studied  are  primarily  those  that  are  military  unique  impacts  not 
likely  to  be  funded  by  other  organizations.  The  burden  is  on  the  Army  to 
prove  beyond  a  reasonable  doubt  that  Army  actions  are  not  a  cause  for 
concern. 

1.3  Objectives 

The  objective  of  this  project  was  to  demonstrate  and  validate  the  VDMTS 
system  and  its  components  through  a  series  of  controlled  field  studies  and 
live  tracking  events. 

1.4  Approach 

A  controlled  field  study  was  used  to  demonstrate  and  validate  that  the 
hardware  can  sufficiently  characterize  vehicle  dynamic  properties  (turning 
radius  and  velocity)  to  accurately  predict  site  impacts  (i.e.,  area  impacted, 
vegetation  loss,  and  rut  depth).  A  controlled  field  study  was  used  to 
demonstrate  and  validate  the  accuracy  of  VDMTS  impact  models  in  pre¬ 
dicting  area  impacted,  vegetation  loss,  and  rut  depth  for  a  range  of  vehi¬ 
cles.  Field  studies  tracking  live  training  exercises  and  subsequent  field 
measurements  were  used  to  demonstrate  and  validate  the  VDMTS  hard¬ 
ware  and  model  performance  in  predicting  site  impacts. 

1.5  Mode  of  technology  transfer 

This  report  will  be  made  accessible  through  the  World  Wide  Web  (WWW) 
at  URLs: 


http://www.cecer.armv.mil 

http://libweb.erdc.usace.armv.mil 
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2  Technology/Methodology  Description 

This  chapter  describes  the  VDMTS  vehicle-based  maneuver  impact  as¬ 
sessment  process  and  the  technology  and  theoretical  models  that  the  sys¬ 
tem  uses.  This  chapter  also  summarizes  the  advantages  and  disadvantages 
of  using  the  VDMTS  process  rather  than  alternative  technologies. 

2.1  Technology/methodology  overview 

The  VDMTS  approach  is  used  to  assess  and  predict  impacts  resulting  from 
military  vehicle-based  maneuver  training.  The  approach  consists  of  vehicle 
impact  models,  vehicle-tracking  hardware  and  software,  and  vehicle¬ 
tracking  data  analysis.  The  following  sections  discuss  each  component  of 
the  VDMTS  approach  in  more  detail. 

2.2  Vehicle-tracking  processes 

Figure  l  shows  the  VDMTS  process,  which  uses  vehicle-tracking  systems 
to  determine  vehicle  location  and  dynamic  operating  characteristics  (e.g., 
turning  radius  and  velocity).  Impact  models  predict  site  impacts  based  on 
vehicle  static  properties  (e.g.,  vehicle  weight  and  type),  vehicle  dynamic 
properties,  and  soil  properties  (soil  strength).  Analysis  routines  summa¬ 
rize  data  in  formats  appropriate  for  land  management  decisions. 

The  VDMTS  vehicle  hardware  consists  of  a  GPS  receiver  integrated  with 
micro  electro  mechanical  systems  (MEMS)  based  strap-down  inertial  sen¬ 
sors  (Cybernet  Systems  2004,  Cybernet  Systems  2002).  These  sensors  en¬ 
able  measurement  of  vehicle  kinematics,  dynamics  and  other  parameters 
of  interest.  The  associated  VDMTS  software  combines  data  from  these 
sensors  to  provide  improved  position  information  even  during  GPS  out¬ 
age.  The  activity  characterization  step  of  Figure  1  shows  this  VDMTS  sys¬ 
tem  component.  VDMTS  hardware  systems  have  been  developed  and  are 
ready  for  demonstration  and  validation.  Alternative  methods  such  as  cus¬ 
tom-built  vehicle-tracking  systems  with  commercial  off-the-shelf  compo¬ 
nents  and  military  standard  training  systems  (Army  Blue  Force  Tracker 
[BFT]  and  National  Guard  Deployable  Force-on-Force  Instrumented 
Range  System  [DFIRST])  could  also  be  used  to  collect  the  vehicle  dynamic 
operating  characteristics  (Anderson  et  al.  2009,  Svendsen  et  al.  2011). 
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Figure  1.  Vehicle-tracking  and  impact  analysis  approach. 


Process-based  vehicle  impact  models  were  developed  through  a  series  of 
controlled  replicated  studies  (Ayers  et  al.  2005,  Ayers  et  al.  2006,  Foster  et 
al.  2006,  Haugen  et  al.  2003).  Vehicles  were  initially  operated  through  de¬ 
fined  courses  to  establish  impacts  over  a  range  of  vehicle  dynamic  operat¬ 
ing  conditions.  Impacts  associated  with  vehicle  use  were  measured  along 
the  course.  Impact  models  were  developed  from  the  field  data  (Li  et  al. 
2007a;  Li  et  al.  2007b).  Impact  models  were  validated  using  a  series  of 
field  studies  of  similar  design  for  a  range  of  ecosystems  including  grass¬ 
lands  and  deserts  (Li  et  al.  2007a;  Li  et  al.  2007b).  The  Impact  Characteri¬ 
zation  step  shown  in  Figure  1  indicates  the  process-based  impact  models. 
An  alternative  method  of  determining  impacts  is  to  implement  the  system 
used  prior  to  the  development  of  the  theoretical  models,  i.e.,  perform  field 
impact  assessments  and  develop  site-specific  regression  models. 

VDMTS  vehicle-tracking  systems  are  used  to  track  vehicles  during  live 
training  exercises.  Location  and  vehicle  dynamic  property  information 
from  the  VDMTS  hardware  are  used  with  the  impact  models  to  predict  the 
cumulative  impact  of  training  exercises.  VDMTS  data  analysis  routines  are 
used  to  post-process  tracking  data.  Analysis  routines  include  spatial  dis¬ 
plays  of  estimated  vegetation  loss  and  soil  rutting,  percent  of  vegetation 
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lost  within  management  areas,  percent  on  and  off-road  traffic,  and  poten¬ 
tial  trail  identification  (Anderson  et  al.  2007,  Ayers  et  al.  2005,  Haugen  et 
al.  2003,  Rice  et  al.  2006,  Wu  et  al.  2004,  Wu  et  al.  2006,  Wu  et  al.  2007). 

The  VDMTS  process  could  strengthen  the  scientific  basis  for  NEPA  anal¬ 
yses  and  other  land  management  decisionmaking  processes  leading  to 
more  sustainable  Army  decisions.  The  VDMTS  process  provides  spatially 
explicit  information  on  vehicle  impact  severity  in  usable  formats. 

2.2.1  Vehicle  impact  models 

The  process-based  impact  models  predict  terrain  impacts  caused  by 
wheeled  and  tracked  vehicles  in  terms  of  percent  vegetation  cover  loss 
(impact  severity),  disturbed  width,  and  rut  depth.  Percent  vegetation  loss 
is  the  primary  measure  of  site  impact  because  it  is  a  primary  variable  used 
in  Army  operational  monitoring  programs  and  an  input  variable  to  many 
ecological  models.  Disturbed  width  is  required  to  convert  linear  distance 
traveled  to  an  area  impacted.  Rut  depth  is  estimated  because  this  variable 
is  highly  correlated  with  vegetation  recovery  rates  and  is  important  to 
models  that  incorporate  micro-topography. 

Process-based,  theoretical  models  were  developed  to  estimate  disturbed 
width  based  on  vehicle  type,  vehicle  dynamic  properties,  and  vehicle  static 
properties.  Disturbed  width  allows  for  the  conversion  from  a  linear  dis¬ 
tanced  tracked  by  the  VDMTS  hardware  to  an  area  impacted.  Individual 
models  were  developed  for  tracked  vehicles  and  for  four,  six,  and  eight¬ 
wheeled  vehicles.  Equation  1  describes  the  disturbed  width  model  for 
tracked  vehicles.  The  full  derivation  of  the  tracked  model  can  be  found  in 
Li  et  al.  (2007b). 


DW  = 


(T£  +  *1L.)  +  (TR  -  -  +  — )2  -  (77?  -  -  -  — ) 

V  2  4 gurTRJ  V  22/  V  22/ 


where: 

DW  =  disturbed  width,  [m] 
TR  =  turning  radius,  [m] 
TL  =  track  length,  [m] 

TW  =  track  width,  [m] 

B  =  tread  width,  [m] 


Eq  1 


ERDC/CERL  TR-12-11 


10 


v  =  velocity  of  the  vehicle,  [m/s] 
g  =  acceleration  of  gravity,  [m/s2] 
fh  =  coefficient  of  lateral  resistance,  [unitless]. 

In  Equation  l,  track  width  (TW)  is  a  vehicle  property  and  is  the  width  of  a 
single  vehicle  track  on  the  vehicle.  Tread  width  (B)  is  a  vehicle  property 
and  is  the  distance  between  the  center  points  of  each  of  the  two  tracks  on  a 
vehicle.  Tread  width  (B)  can  be  thought  of  as  the  effective  width  of  the  ve¬ 
hicle.  Disturbed  width  (DW)  is  a  site  property  and  is  the  width  of  the  con¬ 
tact  area  on  the  ground  that  is  disturbed  by  a  vehicle.  It  is  expected  that  for 
a  vehicle  moving  in  a  straight  line,  the  DW  should  equal  the  TW.  As  the 
vehicle  turns,  the  DW  should  become  wider  than  the  vehicle  TW.  The 
Tread  width  (B)  is  one  factor  that  helps  determine  the  relationship  be¬ 
tween  DW  and  TW.  The  coefficient  of  lateral  resistance  (jui)  is  a  site  factor 
that  affects  DW  (Wong  2001). 

A  similar  process-based,  theoretical  model  was  developed  for  DW  from 
wheel  vehicles.  Li  et  al.  (2007a)  document  DW  equations  and  their  deriva¬ 
tion  for  wheeled  vehicles.  Equations  2  to  12  illustrate  the  general  format 
for  a  four-axled  DW  model.  Figure  2  schematically  shows  the  geometric 
relationship  of  the  variables  for  one  side  of  the  four-axled  vehicle. 

Eq  2 


Eq  3 


Eq  4 


Eq  5 


Where  (see  Figure  2  for  schematic  of  variables): 

R  =  lengths  from  tire  center  to  vehicle  turning  center,  [m] 
L  =  wheelbase,  [m] 
ar  =  slip  angle  of  rear  tire,  [°] 
a/  =  slip  angle  of  front  tire,  [°] 

TR  =  turning  radius,  [m] 
bi  =  distance  between  front  two  tires,  [m] 
b2  =  distance  between  rear  two  tires,  [m]. 


R 


sHtr^b 75) 

(L-i>i)sin(|-ar) 


sin(.Tk^m) 


n  L'SHl+a^-fFrm> 

Kr  ~  .  (  L  \ 

sm\TR-B/ 2) 

n,  _  n&ar-Ti^m) 

Kr  ~  .  (  L—b2  \ 

Sm\TR-B/2j 
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Modified  from  Li  et  al.  (2007b) 

Figure  2.  Eight-wheeled  geometric  relation  and  dynamic  conditions. 

Rf,  R’f,  Rr,  and  R’f  are  ranked  into  Ri,  R2,  R3,  and  R4  so  Ri>  R2>  R3>  R4. 
When  the  vehicle  is  going  straight  ahead,  each  tire  track  completely  over¬ 
laps  the  front  tire  track.  In  this  case,  DW  is  equal  to  the  TW.  However, 
when  the  vehicle  begins  to  turn,  the  rear  tire  tracks  move  away  laterally 
from  front  tire  track  (Figure  3).  Equations  6  to  12  describe  the  relation¬ 
ships  between  DW,  TW,  DWi,  DW2  and  DW3,  Ri,  R2,  R3,  and  R4. 


DW  =  DWt  +  DW2  +  DW3  Eq  6 

where: 

DW1  =  1.5  ■  TW  if  R1  -  R2  >  TW  Eq  7 

DWX  =  R1  —  R2  +  0.5  ■  TW  if  —  R2  <  TW  Eq  8 

DW2  =  TW  if  R2  -R3  >  TW  Eq  9 

DW2  =  R2-  R3  if  R2  R3  <  TW  Eq  10 

DW3  =  1.5  ■  TW  if  R3-R4>  TW  Eq  11 

DW3  =  R3-  R4  +  0.5  ■  TW  if  R3  -  R4  <  T  Eq  12 
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o 

Modified  from  Li  etal.  (2007b) 

Figure  3.  Scenario  of  relationship  between  DW,  Ri,  R2,  R3,  and  R4. 


Process-based  theoretical  models  were  developed  to  estimate  percent  veg¬ 
etation  loss  based  on  vehicle  type,  vehicle  dynamic  properties,  and  vehicle 
static  properties.  Individual  models  were  developed  for  tracked  vehicles 
and  for  four,  six,  and  eight- wheeled  vehicles.  Equation  13  shows  the  vege¬ 
tation  loss  model  for  tracked  vehicles.  The  full  derivation  of  the  tracked 
model  can  be  found  in  Li  et  al.  (2007b).  Loss  of  vegetation  is  mainly  as¬ 
cribed  to  the  shear  displacement  of  the  vegetation  cover  and  the  surface 
soil.  Higher  shear  stresses  produced  at  the  terrain  surface  result  in  more 
shear  displacement  and  consequently,  greater  vegetation  loss.  The  vegeta¬ 
tion  cover  and  the  surface  soil  are  completely  scraped  away  when  the  shear 
stress  reaches  the  maximum  strength  that  the  soil  can  sustain. 

IS  =  (1  -  e-f/K-°-233)  x  100%  Eq  13 

where: 

IS  =  vegetation  loss  (impact  severity),  [%] 
j  =  shear  displacement,  [m] 

K  =  the  shear  deformation  modulus,  [m] 

E  =  approximately  2.718. 

The  value  of  K  depends  on  site  conditions  including  soil  type,  soil  mois¬ 
ture,  and  site  vegetation.  Based  on  experimental  data,  Table  1  lists  K- 
values  for  some  representative  soil  types  under  certain  conditions  (Koolen 
and  Kuipers  1983,  Kogure  et  al.  1982,  Wong  1980,  ASAE  1999). 
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Table  1.  K-values  of  different  soil  types. 


Soil  type  and  conditions 

K  value  (cm) 

Firm  sandy  terrain 

1 

Loose  sand 

2.5 

Clay  at  maximum  compaction 

0.6 

Undisturbed,  fresh  snow 

2.5-5 

Organic  soil  with  a  mat  of  living  vegetation  on  the  surface  and  saturated  peat  below 

14.4-16.4 

Cone  index  (also  cone  penetration  resistance)  is  a  soil  property  that  indi¬ 
cates  the  strength  of  a  soil  and  is  a  function  of  the  in  situ  soil  type,  mois¬ 
ture  condition,  and  vegetation.  K-values  are  empirically  derived  from  cone 
index.  Cone  index  is  a  standard  soil  test  methodology  commonly  used  to 
quantify  soil  strength  in  other  soil  rutting  and  trafficability  models  cur¬ 
rently  used  by  the  DoD  (Ahlvin  and  Haley  1992).  Lower  cone  index  values 
are  associated  with  lower  K-values.  Lower  K-values  are  associated  with 
higher  impacts  for  a  given  turning  radius. 

Using  cone  index  to  quantify  soil  strength  has  several  advantages.  First, 
values  can  be  measure  directly  in  the  field  with  limited  effort.  Second,  soil 
strength  can  be  predicted  using  the  Unified  Soil  Classification  System 
(USCS)  and  soil  moisture.  The  USCS  is  based  on  classifying  soils  according 
to  their  textural  and  plasticity  characteristics.  USCS  classifications  are 
readily  available  for  national  and  internationally  mapped  soils.  If  soil 
moisture  is  not  known  or  measured  in  the  field,  the  Soil  Moisture  Strength 
Prediction  Model  Version  II  (SMSP  II)  (Sullivan  et  al.  1997)  provides 
equations  to  predict  soil  moisture  and  soil  strength  based  on  climatic  data. 

Li  et  al.  (2007a)  document  vegetation  loss  equations  and  their  derivation 
for  wheeled  vehicles.  A  critical  velocity,  vCri,  is  derived  by  balancing  soil 
friction  forces  with  centrifugal  forces  (Equation  14).  The  critical  velocity  is 
defined  as  the  vehicle  speed  where  soil  shear  stress  is  equal  to  the  soil 
shear  strength.  The  vegetation  loss  is  calculated  from  a  ratio  of  actual  ve¬ 
hicle  velocity  to  the  critical  velocity  (Equation^).  Any  increase  in  velocity 
beyond  the  critical  velocity  results  in  the  vehicle  sliding  laterally  and  com¬ 
plete  vegetation  removal  (Equation  16). 
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^cri  ~ 

where: 

Vcri  =  critical  velocity,  [m/s] 
c  =  soil  internal  cohesion,  [Pa] 

A  =  tire-terrain  contact  area,  [m2] 
m  =  vehicle  mass,  [kg] 
g  =  acceleration  of  gravity,  [m/s2] 

4>  =  internal  friction  angle  of  soil  [°]. 

IS  —  (y—)  x  100  if  v  <  vcri 
IS  =  100  if  v  >  vcri 
where: 

IS  =  Impact  severity,  [%] 
v  =  vehicle  velocity,  [m/s] 

Vcri  =  critical  velocity,  [m/s],  calculated  in  Equation  14. 

Impact  models  being  demonstrated  and  validated  incorporate  current  land 
condition  as  vegetation  cover.  Predicted  condition  is  based  on  vegetation 
loss  from  the  prior  condition.  Each  pass  of  a  vehicle  is  treated  as  a  single 
event  with  an  estimated  loss  in  vegetation.  Multiple  pass  traffic  is  predict¬ 
ed  for  each  pass  as  a  single  pass,  but  with  the  initial  vegetation  condition 
being  the  vegetation  remaining  from  the  prior  pass.  These  models  are  pre¬ 
dictive  in  two  respects.  First,  vegetation  loss  is  not  measured  in  the  field, 
but  is  predicted  based  on  vehicle  characteristics  (static  and  dynamic)  and 
site  conditions  (soil  strength).  Second,  predictions  can  be  made  for  other 
site  conditions  (e.g.,  wetter  or  dryer  conditions).  Using  the  same  live  event 
tracking  data,  predictions  can  be  made  for  vegetation  loss  in  wet  soils, 
even  if  the  event  may  have  occurred  during  dry  conditions.  This  prediction 
assumes  that  wet  conditions  do  not  change  the  pattern  of  vehicle  training, 
only  the  magnitude  of  vegetation  loss. 

Rut  depth  or  sinkage  models  have  been  developed  by  the  US  Army  Engi¬ 
neering  Research  and  Development  Center  (ERDC).  The  Vehicle  Terrain 
Interface  (VTI)  is  a  vehicle  terrain  interaction  model  that  predicts  sinkage 
for  vehicles  in  different  soil  conditions  (Richmond  et  al.  2004:  Jones  et  al. 
2007,  Nunez  et  al.  2004).  However,  vehicle-operating  characteristics  (TR 


Eq  15 
Eq  16 
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and  velocity)  are  not  inputs  in  this  model.  Liu  et  al.  (2010)  modified  the 
VTI  model  to  incorporate  weight  shift  due  to  changes  in  TR  and  velocity 
(Equations  17  to  20). 


14 

3 

_ G(bd)2 _ 8  l 

bo(ws+bikwci+b2Fc )  h  1+b/d 

22 

9 

/  -  \8 
1  bQ(ws+bikwd+b2Fc)  b  l+b/d  I 


Wd  = 


2FcHcg 

TW 


where: 


Eq  17 

Eq  18 

Eq  19 
Eq  20 


(Z/d)p  =  sinkage  coefficient  for  powered  wheels 
(Z/d)u  =  sinkage  coefficient  for  unpowered  wheels 
Z  =  sinkage  for  one  wheel 
G  =  cone  index  gradient 
b  =  tire  section  width 
d  =  nominal  wheel  diameter 
h  =  tire  section  height 
8  =  tire  deflection 

ws  =  weight  shift  from  outside  tire  to  inside  tire 
Fc  =  centripetal  (lateral)  force 
b0,  bi,  and  b2  =  turning  force  value  parameters 

k  =  indicator  of  wheel  location  (1  for  outside,  -1  for  inside) 
m  =  mass  of  vehicle  supported  by  single  wheel 
V  =  vehicle  velocity 
TR  =  vehicle  turning  radius 
Hcg  =  vertical  distance  to  vehicle  center  of  gravity 
TW  =  tread  width. 


Lui  et  al.  (2010)  document  the  development  and  use  of  the  TR  modified 
sinkage  models.  This  study  demonstrated  the  use  of  the  TR  modified  sink- 
age  model  against  the  sinkage  model  without  turning  radius  modification. 
Richmond  et  al.  (2004),  Jones  et  al.  (2007),  and  Nunez  et  al.  (2004)  doc¬ 
ument  the  non-modified  sinkage  model. 
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2.2.2  Vehicle-tracking  hardware  and  software 

A  low-cost  VDMTS  was  developed  to  automate  and  enhance  the  process  of 
understanding  the  spatial  and  temporal  characteristics  of  vehicle-based 
impacts  for  assessing  land  condition,  estimating  land  capacity,  and  restor¬ 
ing  lands  in  support  of  DoD  training  requirements  (Figures  4  and  5).  The 
VDMTS  hardware  consists  of  a  GPS  receiver  integrated  with  low-cost 
MEMS-based  strap-down  inertial  sensors.  These  sensors  enable  meas¬ 
urement  of  vehicle  kinematics,  dynamics  and  other  parameters  of  interest 
that  enable  accurate  modeling  of  environmental  impact.  Innovative  sensor 
fusion  software  combines  data  from  these  sensors  to  provide  position  in¬ 
formation  even  during  GPS  outage.  The  system  thereby  provides  vehicle 
dynamics  data  and  positional  information  at  all  times,  even  when  GPS  is 
unavailable.  The  VDMTS  has  the  capability  to  record  the  vehicle  dynamics 
tagged  with  position  information  for  accurate  and  enhanced  post-mission 
analysis  at  substantially  reduced  costs.  Onboard  system  data  storage  pro¬ 
vides  archival  data  for  post  training  event  analysis. 


VDMS  Field  Unit 

Logic: 

Wake-Up  Circuitry 
Data  Storage 
Processor 


Sensors: 

3  Accelerometers 
3  Rate  Gyros 
3  Axis  Magnetometer 
Differential  Odometry 
GPS 

Power: 

From  Batteries 
From  Vehicle 

Communications: 

USB 

Satellite 


Figure  4.  VDMTS  hardware  software  configuration. 
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Figure  5.  VDMTS  Hardware.  The  photo  on  the  left  illustrates  the  hardware  in  the  durable  case 
The  photos  on  the  right  illustrate  the  front  and  back  panels  of  the  VDMTS  unit. 


2.2.3  Vehicle-tracking  data  analysis  routines 

Analysis  routines  were  developed  to  help  users  interpret  the  vehicle¬ 
tracking  data.  Analysis  routines  include:  (l)  identification  of  individual 
and  unit  tracking  patterns,  (2)  identification  of  on  and  off-road  use  pat¬ 
terns,  (3)  identification  of  existing  and  emerging  trail  networks, 

(4)  vegetation  loss  estimates,  (5)  identification  and  prioritization  of  LRAM 
sites  and  (6)  development  of  data  for  carrying  capacity  models.  The  as¬ 
sessment  of  individual  vehicle  impacts  and  impact  patterns  is  intended  to 
address  such  management  issues  as: 

1.  How  much  damage  does  one  type  of  vehicle  cause  relative  to  other  vehicles 
if  operated  under  similar  conditions? 

2.  How  much  damage  does  a  group  of  vehicles  conducting  a  training  exercise 
cause  relative  to  other  training  events? 

3.  Do  the  spatial  impact  patterns  for  individual  units  and  events  differ  from 
the  historic  patterns?  Should  we  expect  new  areas  to  be  impacted  that  have 
not  historically  been  impacted? 

4.  How  much  time  do  vehicles  spend  in  areas  designed  to  minimize  vehicle 
impacts  like  roads  and  staging  areas?  How  much  time  is  spent  in  critical 
habitat  or  near  critical  resources  like  cavity  trees? 

5.  Where  can  we  expect  new  trail  networks  to  form? 

Figure  6  shows  individual  vehicle  and  unit  tracking  patterns  and  off-road 
travel  patterns.  The  inset  map  show  potential  trail  networks.  Figure  7 
shows  vegetation  loss  by  management  area  and  tabular  summaries  from 
the  data. 
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Figure  6.  Summarized  output  from  VDMTS  tracking  system  on  left  shows  individual  vehicle 
travel  patterns.  Thin  light  green  lines  are  installation  road  and  trail  network.  Thick  colored 
lines  show  vehicle  travel.  The  map  on  right  shows  only  off-road  vehicle  travel. 
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Figure  7.  Summarized  output  from  VDMTS  tracking  systems.  The  map  on  left  shows 
vegetation  loss  due  to  vehicle  training  summarized  spatially  as  a  percent  of  total  vegetation 
and  training  area.  The  data  at  top  right  shows  predicted  vegetation  loss  under  dry  and  wet 
conditions  by  vehicle  type.  The  data  at  bottom  right  shows  total  distance  traveled,  off-road 
distance  traveled,  and  average  velocity  by  vehicle  type.  Results  from  this  data  can  be  used  to 

predict  dust  emissions. 
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Methods  were  developed  to  identify  areas  with  single  and  multiple  track¬ 
ing  within  an  event  (Wu  et  al.  2004,  Rice  et  al.  2006).  These  analyses  re¬ 
late  VDMTS  data  directly  with  multiple  pass  studies  commonly  found  in 
the  literature.  Methods  were  developed  to  identify  emerging  trail  networks 
(Wu  et  al.  2006,  Wu  et  al.  2007).  These  methods  use  the  number,  direc¬ 
tion,  timing,  and  vehicle  associated  with  each  pass  in  an  area  to  identify 
the  potential  for  trails  to  develop. 

The  analysis  was  intended  to  identify  emerging  trails  before  severe  im¬ 
pacts  occur  and  proactive  land  management  options  are  available.  Man¬ 
agement  options  may  include  blocking  access  to  trails,  providing  alterna¬ 
tive  trails,  or  hardening  trails.  Methods  exist  to  identify  on  and  off-road 
travel  and  relevant  impact  assessment  parameters  (Ayers  et  al.  2005). 
Tabular  summaries  identify  important  model  input  data  for  other  envi¬ 
ronmental  models  (Figure  7)  (e.g.,  average  velocity,  soil  type  (from  loca¬ 
tion  data),  vehicle  type,  and  total  mileage  for  input  into  dust  models  (An¬ 
derson  et  al.  2007a  and  b).  Another  example  is  percent  off-road  travel  and 
average  vegetation  cover  loss  per  mile  for  development  of  Army  Training 
and  Testing  Area  Carrying  Capacity  (ATTACC)  Training  Impact  Factor 
(TIF)  parameter  development  (Anderson  et  al.  2007a). 

2.3  Advantages  and  limitations  of  the  technology/  methodology 

Table  2  lists  and  briefly  describes  alternative  technologies  or  methodolo¬ 
gies  currently  in  place  that  at  least  partially  meet  the  applicable  need  ad¬ 
dressed  by  the  VDMTS.  Table  2  also  summarizes  advantages,  limitations, 
and  relative  cost  of  the  alternative  technologies. 


Table  2.  Comparison  of  alternative  technologies. 


Technology 

Description 

Advantages 

Limitations 

Costs 

Army  Range  Require¬ 
ments  Model  (ARRM) 

ARRM  is  a  planning  tool  that  models 
training  throughput  requirements  for 
training  and  maneuver  events  for  all  Army 
installations.  ARRM  is  used  to  derive  the 
doctrinal  requirements  for  training  land, 
which  form  the  basis  for  a  variety  of  plan¬ 
ning  exercises. 

Predicted  training  miles  by  unit 
and  event.  Available  for  all  Army 
installations,  units  and  training 
events.  Data  standardized  for 
use  with  other  data  sources. 

Training  data  only  predicted  at 
the  installation  level.  No  in¬ 
formation  on  distribution  in 
time  or  space.  No  site  impact 
prediction.  Does  not  account 
for  changes  in  doctrine. 

No  costs  for  use  in  impact 
assessments  since  main¬ 
tained  by  Army  for  other 
purposes.  Only  cost  is 
interpretation  of  data. 
Costs  not  quantified. 

Range  Facility  Man¬ 
agement  Support  Sys¬ 
tem  (RFMSS) 

RFMSS  is  a  tool  for  scheduling  and  man¬ 
aging  ranges  and  training  areas. 

Available  for  most  Army  and  Ma¬ 
rine  installations.  Provides  near 
future  planned  and  recent  histor¬ 
ical  training  land  usage. 

Training  data  only  at  training 
area  level  (no  distribution  with¬ 
in  area).  Metrics  often  in  units 
difficult  to  relate  to  site  im¬ 
pacts  (e.g.,  training  days).  Data 
often  not  standardized  for  use 
with  other  data  sources. 

No  costs  for  use  in  impact 
assessments  since  main¬ 
tained  by  Army  for  other 
purposes.  Costs  often 
associated  with  data 
QA/QC  and  clean  up.  Cost 
to  summarize  data.  Costs 
not  quantified. 

Range  and  Training 
Land  Assessment 
(RTLA)  program 

Program  to  inventory  and  monitor  instal¬ 
lation  natural  resource  condition.  Often 
includes  measure  of  land-use  intensity. 

Can  provide  temporally  and  spa¬ 
tially  explicit  patterns  of  training 
impacts  when  used  with  other 
data  analysis  methods.  When 
combined  with  ARRM  or  RFMSS 
data,  can  relate  mission  with 
impact. 

Not  available  at  all  installa¬ 
tions.  Data  only  available  on 
annual  or  longer  time  interval. 
Training  activity  is  cumulative 
impact  with  components  not 
defined. 

No  costs  for  use  in  impact 
assessments  if  collected 
for  other  Army  purposes. 
Annual  data  collection 
costs  in  $100Ks. 

Data  analysis  for  applica¬ 
tion  typically  costs  $10K- 
$100K. 

Installation  Specific 
Vehicle  Impact  Studies 

Experimental  studies  designed  to  quanti¬ 
fy  vehicle  impacts.  Frequently  single  to 
multiple  passes  of  a  specific  vehicle. 

Site-specific  data  of  vehicle  im¬ 
pacts  on  installation  resources. 
Good  for  understanding  pro¬ 
cesses  involved  in  training  im¬ 
pacts. 

Data  site-specific.  Vehicle  use 
often  not  representative  of 
actual  use.  Difficult  to  extrapo¬ 
late  to  actual  unit/ event  im¬ 
pact.  No  spatial  information  on 
pattern  of  use. 

Costs  range  from  $50K  to 
>  $1M  depending  on  da¬ 
ta  collected. 
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3  Performance  Objectives 

Table  3  lists  the  performance  objectives  and  metrics.  Performance  metrics 
included  qualitative  and  quantitative  parameters.  Quantitative  parameter 
threshold  values  were  based  on  information  from  previous  studies.  For  ex¬ 
ample,  thresholds  for  accuracy  requirements  for  predicted  DW,  vegetation 
loss,  and  rut  depth  were  based  on:  (1)  variation  typically  seen  in  field 
measurements  of  the  variable,  (2)  variation  in  predicted  impacts  associat¬ 
ed  with  variations  in  input  parameters,  (3)  limitation  introduced  from 
other  sources  of  the  model,  hardware,  or  computations,  (4)  attempt  to  bal¬ 
ance  data  collection  costs  and  data  quality,  and  (5)  accuracy  required  to 
make  management  decisions.  The  metrics  are  based  on  data  that  were  col¬ 
lected  in  the  field.  Performance  metrics  are  organized  by  demonstra¬ 
tion/validation  study  component  and  methodology  component. 

The  following  sections  provide  detailed  descriptions  and  other  information 
on  each  performance  objective/ metric  including  a  summary  of  the  rele¬ 
vance  of  each  objective  to  the  technology  demonstration/validation.  Note 
that  reference  to  numbered  metrics  in  this  chapter  correspond  with  the 
numbered  metrics  in  Table  3. 

3.1  Performance  Objective  1:  Accurate  VDMTS  hardware 
measurement  for  vehicle  dynamic  properties. 

3.1.1  Metric  1.1:  VDMTS  hardware  with  inertial  navigation  system  (INS) 
provides  more  accurate  dynamic  vehicle  properties  than  GPS  alone. 

The  objective  of  Metric  1.1  was  to  test  the  hardware  component  of  the 
VDMTS.  This  metric  tested  the  utility  of  having  INS  incorporated  into  the 
hardware  to  supplement  the  GPS  location  information.  INS  adds  addition¬ 
al  hardware  cost,  but  provides  improved  dynamic  vehicle  properties  in  the 
absence  of  GPS  signals  or  poor  quality  GPS  signals.  The  test  involved  forc¬ 
ing  conditions  to  lose  GPS  signal  quality  and  forcing  INS  subsystem  per¬ 
formance.  Data  requirements  were  simply  performance  of  the  INS  subsys¬ 
tems  with  gain  and  loss  of  GPS  signals.  Evaluation  of  the  INS  subsystem 
performance  was  performed  in  the  single  live  training  event. 


Table  3.  Performance  objectives. 


Performance  Objective 

Metric 

Data  Requirements 

Success  Criteria 

Results 

Quantitative  Performance  Objectives  —  Demonstration  Plan  for  Controlled  Field  Study  and  Live  Training  Single  Event  Study 

1.  Accurate  VDMTS  hard¬ 
ware  measurement  of 
vehicle  dynamic  proper¬ 
ties. 

1.1.  VDMTS  hardware  with  INS 
provides  more  accurate  dy¬ 
namic  vehicle  properties 
than  GPS  alone 

Vehicle  position  data  without  GPS 
signal 

Ability  to  record  in  situations  when 
GPS  signals  not  available  due  to 
topography,  vegetation,  and  related 
conditions. 

Success  Criterion  Met: 

■  Hardware  with  INS  improved  dynamic  proper¬ 
ty  measurement. 

1.2.  VDMTS  hardware  provides 
sufficient  dynamic  vehicle 
properties  to  predict  vegeta¬ 
tion  loss  and  soil  rutting. 

Vehicle  positional  accuracy 

Vehicle  turning  radius  accuracy 
Vehicle  velocity  accuracy 

Vehicle  positional  accuracy  within 

5  m  (16.4  ft)  95%  of  the  time. 
Vehicle  turning  radius  within  10  m 
(32.8  ft)  95%  of  the  time. 

Vehicle  velocity  within  2.24  m/s 
(5  mph)  95%  of  the  time. 

Success  Criteria  Met: 

■  Position  within  5  m  99.9%  of  recording  time 

■  Average  Positional  Accuracy  =  2.05  m. 

Success  Criterion  Met: 

■  TR  within  10  m  95%  of  the  time. 

Success  Criteria  Met: 

■  Velocity  within  2.24  m/s  100%  recording 
time 

■  Average  Velocity  error  =  -0.07  m/s. 

2.  Accurate  VDMTS  impact 
model  predictions  of  site 
impacts  under  controlled 
condition 

2.1.  Correspondence  between 
predicted  and  measured 

DW,  vegetation  loss  and  rut 
depth  of  site  damage  asso¬ 
ciated  with  individual  vehicle 

use 

Disturbed  width 

Vegetation  loss 

Rut  depth 

Correlation  between  predicted  and 
measured  DW  >  0.8. 

Predicted  DW  within  20  cm  of  ac¬ 
tual  disturbed  width  for  95%  of 
sample  points. 

Correlation  between  predicted  and 
measured  vegetation  loss  >  0.7. 
Predicted  vegetation  loss  within 

20%  of  actual  vegetation  loss  for 
95%  of  sample  points. 

Correlation  between  predicted  and 
measured  rut  depth  >  0.6. 

Predicted  rut  depths  within  3  cm  of 
actual  rut  depths  for  95%  of  sam¬ 
ple  points. 

Success  Criterion  Met: 

■  Correlation  between  predicted  and  measured 
DW  =  0.89. 

Success  Criterion  Not  Met: 

■  Predicted  DW  within  20  cm  of  actual  dis¬ 
turbed  width  for  50%  of  sample  points. 

Success  Criterion  Met: 

■  Correlation  between  predicted  and  measured 
vegetation  loss  >  0.9. 

Success  Criterion  Not  Met: 

■  Predicted  vegetation  loss  within  20%  of  ac¬ 
tual  vegetation  loss  for  86%  of  sample 
points. 

Success  Criterion  Not  Met: 

■  Correlation  between  predicted  and  measured 
rut  depth  <  0.6. 

Success  Criterion  Not  Met: 

■  Predicted  rut  depths  within  3  cm  of  actual  rut 
depths  for  94%  of  sample  points. 

to 
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Performance  Objective  Metric  Data  Requirements  Success  Criteria  |  Results 

3.  Accurate  VDMTS  hard-  3.1.  VDMTS  hardware  provides  Vehicle  positional  accuracy  Vehicle  positional  accuracy  within 

ware  measurement  of  sufficient  static  and  dynamic  10  m  (32.8  ft)  for  300  m  (984.2  ft) 

vehicle  static  and  dynam-  vehicle  properties  to  predict  after  GPS  signal  lost  90%  of  time, 

ic  properties.  vegetation  loss  and  soil  rut¬ 

ting  without  GPS  signal. 


Correspondence  between  DW  Predicted  DW  within  20  cm  of  ac-  Success  Criteria  Not  Met: 

predicted  and  measured  Vegetation  loss  tual  disturbed  width  in  90%  of  the  ■  Predicted  DW  within  20  cm  of  actual  dis- 

DW,  vegetation  loss  and  rut  RUt  depth  sample  sites.  turbed  width  in  45.6%  of  the  sample  sites 

depth  of  site  damage  asso-  Predicted  vegetation  loss  within  ■  Average  error  between  predicted  and  meas- 

ciated  with  vehicle  use.  20%  of  actual  vegetation  loss  in  ured  data  =  14.9  cm. 

80%  of  the  sample  sites.  Success  Criteria  Met: 

Predicted  rut  depth  within  4  cm  of  1  Predicted  vegetation  loss  within  20%  of  ac- 
actual  rut  depth  in  80%  of  the  tual  vegetation  loss  in  95%  of  the  sample 

sample  sites.  sites 

■  Average  error  between  predicted  and  meas¬ 
ured  vegetation  loss  =-1.8%. 

Success  Criteria  Met: 

■  Predicted  rut  depth  within  4  cm  of  actual  rut 
depth  in  100%  of  the  sample  sites 

■  Average  error  between  predicted  and  meas¬ 
ured  rut  depth  =  0.1  cm. 

Reliable  hardware  use  Percent  of  recording  time  cap-  Percent  of  recording  time  >  80%  of  Success  Criterion  Met: 

tured  military  unit  training  time.  ■  85.5%  of  military  training  time  recorded. 

Quantitative  Performance  Objectives  -  Demonstration  Plan  for  Live  Training  Multiple  Event  Study 


6.  VDMTS  Hardware  dura¬ 
bility 

6.1.  Reliable  hardware  use 

Percent  of  recording  time  cap¬ 
tured 

Percent  of  recording  time  >  80%  of 
training  time  per  vehicle  type  for 
any  event 

Success  Criteria  Met: 

■  90.2%  of  total  training  time  recorded 

■  (p  =  0.0002) 

■  >  80%  training  time  by  vehicle  recorded  ex¬ 
cept  for  Heavy  Expanded  Mobility  Tactical 
Truck  (HEMTT). 

7.  Ease  of  system  use 

7.1.  Ability  of  a  technician-level 
individual  to  install  and 

maintain  hardware 

Training  time 

Hardware  setup/take-down  time 

<4  hrs/Person 

<1  hr  total/vehicle  (Setup  and 
take-down) 

Success  Criterion  Met: 

■  0.3hrs/Person  (p  <  0.05). 

Success  Criterion  Met: 

■  0.19  hr/vehicle  (p  <  0.05). 

to 
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4.  Accurate  VDMTS  model  4.1. 
predictions  of  site  im¬ 
pacts  during  live  training 


5.  VDMTS  Hardware  dura-  5.1. 
bility 


Success  Criteria  Met: 

•  Vehicle  positional  accuracy  within  10  m  (32.8 
ft)  for  300  m  (984.2  ft)  after  GPS  signal  lost 
100%  of  time 

■  Average  GPS  signal  error  1.6  m  (±  0.1  m) 

■  Average  error  between  INS  and  GPS  data 
0.164±0.002  m. 
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Performance  Objective 


8.  Quality  and  accuracy  of 
data  for  land-use  deci- 


Metric 

Data  Requirements 

Success  Criteria 

Results 

7.2.  Ability  of  a  technician-level 
individual  to  retrieve  and 
quality  assurance/quality 
control  (QA/QC)  data 

Training  time 

QA/QC  time 

<4  hrs/Person 
<1  hr/vehicle  data  file 

Success  Criterion  Met: 

■  1.07  hrs/Person  training  time  (p  <  0.05). 

Success  Criterion  Met: 

■  0.82  hr/vehicle  data  file  QA/QC  time  (p  < 
0.05). 

7.3.  Ability  of  a  technician-level 
individual  to  summarize  re¬ 
sults 

Training  time 

Analysis  time 

<16  hrs/Person 
<  8  hr/Event  Analysis 

Success  Criterion  Met: 

•  6.33  hrs/Person  training  time  (p  <  0.05). 

Success  Criterion  Met: 

■  5.45  hr/Event  Average  Analysis  time  (p  < 
0.05). 

8.1.  Ability  to  use  data  for  pa¬ 
rameterization  of  models 

Vehicle  position 

DW 

Vegetation  loss 

Time  off-road 

<  10  m  position  error 

<  20%  error  for  time  off-road,  and 
impact  severity 

Success  Criterion  Met: 

•  1.6  m  position  accuracy. 

Success  Criterion  Met: 

■  6.3%  error  impact  severity. 

Success  Criterion  Met: 

•  1.0%  error  estimating  time  off-road. 

8.2.  Ability  to  use  data  to  identify 
training  area  use  patterns 

Vehicle  positional  accuracy 
Vegetation  loss 

<10  m  position  error  for  LRAM  ID 

<  5  m  position  error  for  TES  habitat 
analysis 

<  20%  error  in  veg.  loss 

Success  Criterion  Met: 

•  1.6  m  position  error  for  LRAM  ID. 

Success  Criterion  Met: 

•  1.6  m  position  error  for  TES  habitat  analysis. 

Success  Criterion  Met: 

■  6.3%  error  estimating  vegetation  loss. 

Qualitative  Performance  Objectives  -  Demonstration  Plan  for  Live  Training  Multiple  Event  Study 


9.  Ease  of  system  use 


10. Quality  and  accuracy  of 
data  for  land-use  deci¬ 
sions 


9.1.  Ability  of  a  technician-level  Questionnaire  feedback  from  the 
individual  to  install,  remove,  technician  on  usability  of  hard- 
and  review  collected  data  ware 

10.1.  Ability  to  use  data  for  pa-  Questionnaire  feedback  from 
rameterization  and  identify  researchers  on  usability  of  sys- 
training  area  use  patterns  tern  results 


Usable  hardware  system,  QA/QC 
process,  and  analyses  processes 

Usable  analysis  results 


Success  Criterion  Met: 

■  Usable  hardware  system,  QA/QC  process, 
and  analyses  processes. 

Success  Criterion  Met: 

■  Usable  analysis  results. 


nj 
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It  was  assumed  that,  if  VDMTS  hardware  can  meet  these  defined  metrics, 
the  system  could  sufficiently  monitor  vehicle  dynamic  properties  to  gener¬ 
ate  input  parameter  values  for  the  impact  models.  Data  were  analyzed  to 
compare  cost  to  performance  of  alternative  hardware. 

3.1.2  Metric  1.2:  VDMTS  hardware  provides  sufficient  dynamic  vehicle 
properties  to  predict  vegetation  loss  and  soil  rutting 

The  objective  of  Metric  1.2  was  to  test  the  hardware  component  of  the 
VDMTS.  The  metric  tested  the  VDMTS  hardware’s  ability  to  measure  vehi¬ 
cle  dynamic  properties  (position,  velocity,  and  turning  radius).  Vehicle  po¬ 
sition,  velocity,  and  turning  radius  were  selected  because  those  are  the  in¬ 
put  parameters  required  by  the  impact  models.  Success  criteria  for  vehicle 
position,  velocity,  and  turning  radius  were  based  on  a  considerations  for 
hardware  cost  and  impact  model  input  requirements.  Impact  model  inputs 
were  based  on  sensitivity  of  the  impact  models  to  input  parameters  and 
relative  effect  of  changes  in  output  on  model  interpretations.  Because  the¬ 
se  threshold  values  are  somewhat  subjective  (based  on  research  team’s  in¬ 
terpretation  of  data),  field  tests  were  conducted  with  reference  systems  (or 
study  controls).  Reference  systems  were  a  high-cost,  high-precision  GPS 
system  and  alternative  low-cost,  custom-made,  vehicle-tracking  systems 
consisting  of  only  low-cost  GPS  units  without  INS.  These  controls  bound 
the  upper  and  lower  limits  of  vehicle-tracking  hardware  with  minimum 
and  maximum  cost  alternatives. 

It  was  assumed  that,  if  the  VDMTS  hardware  can  meet  these  defined  met¬ 
rics,  the  system  could  sufficiently  monitor  vehicle  dynamic  properties  to 
generate  input  parameter  values  for  the  impact  models.  Data  were  ana¬ 
lyzed  to  compare  cost  to  performance  of  alternative  hardware. 

3.2  Performance  Objective  2:  Accurate  VDMTS  impact  model 
predictions  of  site  impacts  under  controlled  condition 

3.2.1  Metric  2.1:  Correspondence  between  predicted  and  measured  DW, 
vegetation  loss  and  rut  depth  of  site  damage  associated  with  individual 
vehicle  use 

The  objective  of  Metric  2.1  was  to  test  the  impact  model  component  of  the 
VDMTS.  One  metric  was  considered:  the  accuracy  of  the  model  to  predict 
impacts  for  an  expected  range  of  vehicle  static  and  dynamic  properties. 
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Metric  threshold  values  were  set  for  each  major  impact  model  prediction 
(DW,  vegetation  loss,  and  rut  depth).  Threshold  values  for  each  of  the 
three  model  outputs  were  defined  in  two  ways.  First,  a  correlation  was 
found  between  actual  and  predicted  values  across  the  range  of  conditions 
tested.  This  metric  is  important  to  establish  so  that  the  model  accurately 
captured  the  overall  relationship  between  vehicle  properties  and  site  im¬ 
pact.  A  correlation  greater  than  the  specified  threshold  assured  that  the 
impact  models  accurately  represented  the  relationship  between  vehicle 
dynamic  properties  and  site  impact  across  the  complete  range  of  potential 
vehicle-operating  conditions. 

Second,  an  overall  output  accuracy  (i.e.,  predicted  value  was  within  a  set 
value  of  the  actual  value  for  all  sample  data)  was  assessed.  The  majority  of 
vehicle  dynamic  properties  (velocity,  turning  radius)  observed  in  actually 
training  were  often  a  subset  of  potential  range  of  properties.  For  example, 
vehicles  rarely  traveled  at  high  speeds  while  making  sharp  turns.  An  over¬ 
all  output  accuracy  across  the  range  of  values  ensured  the  model  predicted 
accurately  for  commonly  occurring  conditions.  As  an  example,  vegetation 
loss  dramatically  increases  at  a  critical  threshold  turning  radius.  Predict¬ 
ing  loss  at  this  critical  value  is  important  to  predicting  overall  cumulative 
impact  and  may  not  be  well  represented  in  an  overall  correlation. 

Metrics  were  tested  with  controlled  field  studies  including  vehicle  static 
properties  (vehicle  weight,  etc),  vehicle  dynamic  properties  (turning  radi¬ 
us,  velocity),  multiple  passes,  and  different  site  conditions.  Two  main  tests 
were  performed:  alpha  and  beta  tests.  The  alpha  test  tested  the  models  in 
a  region  included  in  the  original  model  development  (Fort  Riley).  The  beta 
test  tested  the  models  in  regions  not  included  in  original  model  develop¬ 
ment  (Eglin  Air  Force  Base  [AFB,]  and  Pohakuloa  Training  Area).  The  al¬ 
pha  test  tested  the  models  at  Fort  Riley,  a  location  included  in  the  original 
model  development.  As  such,  the  general  site  conditions  were  similar  in¬ 
cluding  native  prairie  grassland  vegetation  and  similar  soils.  However,  site 
conditions  of  the  alpha  test  varied  from  the  conditions  used  in  the  original 
test. 

The  alpha  test  also  included  four  different  vehicle  types  (two-wheeled, 
two-tracked).  The  alpha  test  included  multiple  tracking  that  was  not  in¬ 
cluded  in  the  earlier  Fort  Riley  study.  The  beta  test  tested  the  models  at 
Eglin  AFB  and  Pohakuloa  Training  Area,  locations  not  included  in  the 
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original  model  development.  As  such,  the  general  site  conditions  were  dif¬ 
ferent  including  vegetation  types  and  soils  not  previously  included  in 
model  development.  The  beta  test  included  some  vehicles  types  different 
from  those  previously  tested.  The  beta  test  included  multiple  tracking  that 
was  not  included  in  the  earlier  model  development  datasets.  The  beta  test 
included  three  different  vehicle  types. 

It  was  assumed  that,  if  the  VDMTS  impact  models  can  meet  these  defined 
metrics,  the  models  were  sufficient  to  predict  site  impacts  during  live 
training  for  the  range  of  vehicles  types  and  training  doctrine  likely  to  be 
encountered  in  the  field. 

3.3  Performance  Objective  3:  Accurate  VDMTS  hardware 
measurement  of  vehicle  static  and  dynamic  properties 

3.3.1  Metric  3.1:  VDMTS  hardware  provides  sufficient  static  and  dynamic 
vehicle  properties  to  predict  vegetation  loss  and  soil  rutting  without  GPS 
signal 

The  objective  of  Metric  3.1  was  to  test  the  hardware  component.  Specifical¬ 
ly  the  test  evaluated  the  utility  of  the  INS  system  in  the  live  training  event. 
The  metrics  were  tested  with  data  from  tracking  of  a  live  field  training 
event.  The  performance  of  the  INS  was  dependent  on  what  the  vehicle  is 
doing  (e.g.,  traveling  fast  or  slow,  making  sharp  or  gradual  turns,  traveling 
on  rough  to  smooth  terrain,  etc.).  Data  were  obtained  from  a  live  event 
that  captures  actual  vehicle  use  patterns.  Tracking  systems  stored  both 
GPS  and  INS  signals  separately  resulting  in  three  data  sets:  (1)  GPS  only, 
(2)  INS  only,  and  (3)  Geographic  Positioning  and  Inertial  Navigation  Sys¬ 
tem  (GPS/INS)  combined  signals.  These  three  datasets  allowed  research¬ 
ers  to  identify  any  point  during  the  training  event  and  evaluate  GPS  signal 
loss  starting  at  that  time.  From  that  start  point,  location,  turning  radius 
and  velocity  were  calculated  for  each  dataset  for  a  period  into  the  future 
until  the  evaluation  metric  is  exceeded  for  the  INS-only  dataset.  A  system¬ 
atic  sampling  was  made  from  the  complete  tracking  event  to  identify  simu¬ 
lated  GPS  signal  loss  times. 

The  evaluation  criteria  evaluated  the  positional  accuracy  when  GPS  signal 
was  unavailable.  It  was  assumed  that  if,  the  VDMTS  passed  this  test,  then 
the  INS  hardware  provided  additional  value  over  GPS  only  hardware. 
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3.4  Performance  Objective  4:  Accurate  VDMTS  model  predictions  of 
site  impacts  during  live  training 

3.4.1  Metric  4.1:  Correspondence  between  predicted  and  measured  DW, 
vegetation  loss  and  rut  depth  of  site  damage  associated  with  vehicle  use 

The  objective  of  Metric  4.1  was  to  test  the  combination  of  the  hardware  and 
impact  model  components.  One  metric  was  considered:  the  accuracy  of  the 
model  in  predicting  impacts  for  actual  vehicle  use  during  live  training. 
Threshold  values  were  set  for  each  major  impact  model  prediction  (DW, 
vegetation  loss,  and  rut  depth).  Threshold  values  for  each  of  the  three  model 
outputs  were  defined.  An  overall  output  precision  (i.e.,  with  a  specified 
amount  of  the  actual  value)  for  a  specified  percentage  of  all  impact  areas 
was  assessed.  These  values  reflected  the  same  level  of  accuracy  defined  for 
previous  objectives.  However,  the  percentage  of  impact  points  correctly 
predicted  was  lower.  This  lower  percentage  was  because  of  additional  un¬ 
certainty  about  site  condition  like  soil  type,  soil  moisture,  and  vegetation. 

Metrics  were  tested  through  the  tracking  of  a  live  field  training  event  at 
three  test  sites.  Vehicles  of  different  types  and  expected  use  patterns  were 
selected  through  consultation  with  installation  representatives.  Vehicles 
were  tracked  for  approximately  1  week.  Researchers  randomly  selected 
predicted  impact  points,  located  those  points  in  field,  and  measured  actual 
impacts.  Comparison  of  predicted  and  actual  impacts  determined  system 
performance.  The  first  site  was  a  grassland  installation  (Fort  Riley)  with 
significant  off-road  travel,  but  with  limited  signal  interference  expected. 
The  second  site  was  a  forested  installation  (Fort  Benning)  with  extensive 
road/trail  travel  and  greater  signal  interference  expected.  In  the  single  live 
training  events,  38  vehicles  were  tracked  across  the  two  installations. 

It  was  assumed  that,  if  the  VDMTS  hardware  and  impact  models  met  these 
defined  metrics,  they  were  sufficient  to  predict  site  impacts  during  live 
training. 
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3.5  Performance  Objective  5:  VDMTS  hardware  durability  during  live 
training  single  event  study 

3.5.1  Metric  5.1:  Reliable  hardware  use 

The  objective  of  Metric  5.1  was  to  evaluate  hardware  performance  and  du¬ 
rability  during  a  single  live  training  event.  One  metric  was  considered:  the 
percent  of  total  data  collected.  In  other  words,  the  percent  of  total  data  lost 
due  to  any  hardware  failure  including  loss  of  unit,  loss  of  power,  or  failure 
of  any  hardware  component. 

It  was  assumed  that,  if  VDMTS  hardware  met  this  defined  metric,  it  was 
sufficiently  durable  to  track  multiple  events  reliably. 

The  metric  was  tested  using  tracking  of  a  live  field  training  event  at  three 
tests  sites.  Vehicles  of  different  types  and  expected  use  patterns  were  se¬ 
lected  in  consultation  with  installation  representatives.  The  first  site,  a 
grassland  installation  (Fort  Riley),  has  significant  off-road  travel,  but  has 
limited  signal  interference  expected.  The  second  site,  a  forested  installa¬ 
tion  (Fort  Benning),  has  extensive  road/trail  travel  and  greater  signal  in¬ 
terference  expected.  The  third  site,  Pohakuloa  Training  Area,  had  little  de¬ 
veloped  networks  so  it  was  anticipated  that  off-road  training  would  occur. 
This  also  allowed  the  opportunity  to  test  the  models  under  conditions  out¬ 
side  of  those  where  they  were  developed.  Vehicles  were  tracked  for  ap¬ 
proximately  1  week.  Actual  usable  data  were  compared  with  potential  data 
to  determine  metric  success.  Total  available  data  were  determined  based 
on  study  start  time,  study  end  time,  and  data  collection  rate.  In  this  phase 
of  the  study  2254.8  hours  of  data  were  collected  out  of  a  total  training  time 
of  2637.6  hours. 

3.6  Performance  Objective  6:  VDMTS  hardware  durability  during  live 
training  multiple  event  study 

3.6.1  Metric  6.1:  Reliable  hardware  use 

The  objective  of  Metric  6.1  was  to  evaluate  hardware  performance  and  du¬ 
rability  of  the  VDMTS  system  to  collect  data  during  live  training  events. 
One  metric  was  considered:  the  percent  of  total  data  for  each  vehicle  type 
collected  (i.e.,  the  percent  of  total  data  for  each  vehicle  type  not  lost  due  to 
any  hardware  failure  including  loss  of  unit,  loss  of  power,  or  failure  of  any 
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hardware  component  to  function  properly).  The  metric  was  tested  using 
tracking  of  multiple  live  field  training  events.  Vehicles  of  different  types 
and  expected  use  patterns  were  selected  in  consultation  with  installation 
representatives.  Vehicles  were  tracked  for  approximately  l  week.  Actual 
usable  data  were  compared  with  total  potential  data  to  determine  metric 
success.  Total  available  data  were  determined  based  on  study  start  time, 
study  end  time,  and  data  collection  rate.  Data  were  summarized  by  vehicle, 
event,  installation  and  overall  performance.  Events  were  tracked  at  Fort 
Riley,  Fort  Benning,  and  Pohakuloa  Training  Area.  A  total  of  14  events 
(136  vehicles  across  nine  vehicle  types),  were  tracked  (Appendix  B  in¬ 
cludes  a  comprehensive  table  of  vehicles  tracked  by  date  and  location.) 
Percent  recording  time  criteria  success  was  evaluated  using  a  one-sided  T- 
test  to  test  the  hypothesis  that  VDMTS  hardware  recording  time  statisti¬ 
cally  exceeded  the  success  criteria.  A  total  of  13587.1  hours  out  of  15056.8 
possible  training  hours  were  recorded. 

It  was  assumed  that,  if  the  VDMTS  hardware  met  this  defined  metric,  it 
was  sufficiently  durable  to  track  multiple  events  reliably. 

3.7  Performance  Objective  7:  Ease  of  system  use 

3.7.1  Metric  7.1:  Ability  of  a  technician-level  individual  to  install  and 
maintain  hardware 

The  objective  of  Metric  7.1  was  to  determine  the  effort  required  to  train  a 
technician  to  properly  instrument  a  vehicle  and  to  instrument  vehicles  for 
tracking  events.  Two  metrics  were  considered:  time  to  train  the  technician 
and  time  to  instrument  a  vehicle.  The  metrics  were  tested  by  training  one 
or  more  technicians  at  each  installation  (Fort  Riley,  Fort  Benning,  and 
Pohakuloa  Training  Area)  in  use  of  VDMTS  hardware  and  vehicle  mount¬ 
ing.  Training  times  were  recorded.  Live  training  events  were  identified  for 
tracking  in  coordination  with  the  installation.  Installation  technicians 
mounted  VDMTS  systems.  Mounting  times  were  recorded  for  each  event. 
After  the  training  event,  installation  technicians  removed  VDMTS  hard¬ 
ware.  Removal  types  for  each  event  were  recorded.  Actual  training  time 
and  combined  VDMTS  mounting/dismounting  times  were  compared  with 
the  success  criteria.  Events  were  tracked  at  Fort  Riley,  Fort  Benning,  and 
Pohakuloa  Training  Area.  A  total  of  14  events  were  tracked  (136  vehicles 
across  nine  vehicle  types)..  Mounting/dismounting  criteria  success  was 
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evaluated  using  a  one-sided  T-test  to  test  the  hypothesis  that  vehicle  set- 
up/take-down  times  were  statistically  less  than  the  success  criteria. 

It  was  assumed  that,  if  the  VDMTS  system  met  this  defined  metric,  it  was 
sufficiently  easy  to  setup  and  take-down. 

3.7.2  Metric  7.2:  Ability  of  a  technician-level  individual  to  retrieve  and 
QA/QC  data 

The  objective  of  Metric  7.2  was  to  determine  the  effort  required  to  train  a 
technician  to  check  the  quality  of  data  obtained  from  VDMTS  hardware 
mounted  on  vehicles  during  live  training  events.  Two  metrics  were  consid¬ 
ered:  time  to  train  the  technician  and  time  to  check  data  quality.  The  met¬ 
rics  were  tested  by  training  one  or  more  technicians  at  each  installation 
(Fort  Riley,  Fort  Benning,  and  Pohakuloa  Training  Area)  to  check  the 
quality  of  data  from  VDMTS  hardware  units  that  were  mounted  on  mili¬ 
tary  vehicles.  Training  times  were  recorded.  Live  training  events  were 
identified  for  tracking  in  coordination  with  the  installation.  VDMTS  sys¬ 
tems  were  mounted  on  training  vehicles. 

After  the  training  event,  VDMTS  hardware  was  removed  from  the  vehicles. 
Installation  level  technicians  downloaded  the  VDMTS  data  and  performed 
QA/QC  data  checks.  QA/QC  data  checks  consisted  of  opening  the  vehicle¬ 
tracking  file  (.vdm  file)  on  a  computer  to  verily  completeness,  ensure  that 
correct  vehicle  information  and  training  mission  were  recorded,  confirm 
that  the  file  was  in  proper  format  and  not  corrupted,  and  confirm  that  ad¬ 
equate  vehicle  positional  accuracy  had  been  obtained.  Events  were  tracked 
at  Fort  Riley,  Fort  Benning,  and  Pohakuloa  Training  Area.  A  total  of  14 
events  were  tracked  (136  vehicles  across  nine  vehicle  types).  (Appendix  B 
includes  a  comprehensive  table  of  vehicles  tracked  by  date  and  location.) 
Actual  QA/QC  times  and  QA/QC  success  criteria  were  compared.  QA/QC 
criteria  success  was  evaluated  using  a  one-sided  T-test  to  test  the  hypothe¬ 
sis  that  QA/QC  times  are  statistically  less  than  the  criteria. 

It  was  assumed  that,  if  the  VDMTS  system  met  this  defined  metric,  the  da¬ 
ta  QA/QC  process  was  sufficiently  easy  for  installation  use. 
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3.7.3  Metric  7.3:  Ability  of  a  technician-level  individual  to  summarize 
results 

The  objective  of  Metric  7.3  was  to  determine  the  effort  required  to  train  a 
technician  to  analyze  VDMTS  data  and  to  analyze  data  obtained  from 
VDMTS  hardware  mounted  on  vehicles  during  live  training  events.  Two 
metrics  were  considered:  time  to  train  the  technician  and  time  to  analyze 
the  data.  The  metrics  were  tested  by  training  one  or  more  technicians  at 
each  installation  (Fort  Riley,  Fort  Benning,  and  Pohakuloa  Training  Area) 
to  conduct  routine  data  analyses.  Live  training  events  were  identified  for 
tracking  in  coordination  with  the  installation.  VDMTS  systems  were 
mounted  on  training  vehicles.  After  the  training  event,  VDMTS  hardware 
was  removed  from  the  vehicles.  Installation  level  technicians  analyzed 
VDMTS  data  and  summarized  results.  The  amount  of  time  to  train  the 
technician  and  the  amount  to  time  the  technician  required  to  conduct  each 
analysis  were  recorded.  Events  were  tracked  at  Fort  Riley,  Fort  Benning, 
and  Pohakuloa  Training  Area.  A  total  of  14  events  were  tracked  (136  vehi¬ 
cles  across  nine  vehicle  types).  (Appendix  B  includes  a  comprehensive  ta¬ 
ble  of  vehicles  tracked  by  date  and  location.)  Actual  analysis  and  VDMTS 
analysis  were  compared  with  the  success  criteria.  Analysis  criteria  success 
was  evaluated  using  a  one-sided  T-test  to  test  the  hypothesis  that  analysis 
times  were  statistically  less  than  the  criteria. 

It  was  assumed  that,  if  the  VDMTS  system  met  this  defined  metric,  the  da¬ 
ta  analysis  process  was  sufficiently  easy  for  installation  use. 

3.8  Performance  Objective  8:  Quality  and  accuracy  of  data  for  land- 
use  decisions 

3.8.1  Metric  8.1:  Ability  to  use  data  for  parameterization  of  models 

The  objective  of  this  metric  was  to  determine  if  the  data  quality  was  suffi¬ 
cient  for  use  as  inputs  in  models  (e.g.,  Fort  Riley  nLS  model,  ATTACC) 
used  in  land-use  decision  making  (Bussen  2009,  Sullivan  et  al.  1997,  Sulli¬ 
van  and  Anderson  2000).  Data  accuracy  refers  to  the  closeness  of  the  data 
to  its  true  values.  In  this  demonstration,  DW,  vegetation  loss,  and  impact 
severity  data  and  their  associated  accuracies  were  predicted  based  on  the 
models  previously  validated  in  the  first  demonstration  phase  (Section  5.2, 
p  49).  However,  the  accuracy  of  these  predictions  depends  on  the  accuracy 
of  the  vehicle  positional  data.  The  VDMTS  system  analyzed  the  accuracy  of 
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each  data  point  based  on  satellite  reception  and  differential  correction. 
Previously  demonstrated  accuracy  was  combined  with  measured  vehicle 
positional  accuracy  to  determine  applicability  of  system  for  different  land- 
use  decisions  under  this  demonstration.  The  resolution  of  each  specific 
model  defined  the  acceptable  accuracy  of  data  for  model  parameterization. 
If  accuracy  was  greater  than  the  model  resolution,  the  data  quality  was 
sufficient  for  model  parameterization.  Model  resolution  and  input  re¬ 
quirements  were  obtained  from  literature  and  individuals  researching 
model  implementation  and  development  on  installations. 

Depending  on  the  model,  different  data  types  are  required.  Vehicle  posi¬ 
tion  was  required  to  accurately  predict  DW  and  vegetation  removal.  These 
data  allow  for  more  accurate  parameterization  of  a  Kinematic  Wave  model 
used  at  Fort  Riley  to  predict  erosion  and  gully  formation.  Currently,  the 
model  uses  land-use/landcover  data  to  predict  the  surface  roughness  (i.e., 
Manning’s  n)  from  a  lookup  table  (Bussen  2009).  The  spatial  resolution  of 
this  land-use/landcover  dataset  is  30  m.  Vegetation  removal  data  acquired 
following  a  training  event  could  be  combined  with  the  land-use/landcover 
dataset  resulting  in  more  accurate  surface  roughness  estimations  (e.g.,  an 
area  under  heavy  training  with  high  vegetation  loss  might  be  considered 
bare  instead  of  the  mixed  prairie  determination  from  the  land- 
use/landcover  data).  The  model  uses  10  m  resolution  elevation  data. 
Therefore,  the  vehicle  positional  accuracy  must  be  <10  m.  If  3  m  positional 
accuracy  is  obtained,  3  m  resolution  elevation  data  could  be  used  for  the 
model  producing  results  that  are  even  more  reliable. 

The  VDMTS  calculated  percent  time  off-road,  vegetation  loss,  and  impact 
severity  allow  for  better  estimates  of  the  Vehicle  Off-Road  Factor,  Vehicle 
Severity  Factor,  and  Vehicle  Conversion  Factor  for  the  ATTACC  methodol¬ 
ogy.  Sullivan  and  Anderson  (2000)  described  a  methodology  for  estimat¬ 
ing  ATTACC  parameters  that  compared  the  existing  method  with  subject 
matter  experts  assigned  factors.  The  average  error  between  these  two 
methods  was  approximately  20%.  Therefore,  the  success  criteria  estab¬ 
lished  for  time  off-road,  vegetation  loss,  and  impact  severity  was  an  error 
<20%.  Errors  <20%  result  in  values  that  are  more  accurate  than  previous¬ 
ly  used.  The  error  was  calculated  by  combining  validated  model  accuracy 
with  observed  VDMTS  positional  accuracy  demonstrated. 
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The  metrics  were  tested  by  performing  routine  data  analysis  following 
training  events.  Live  training  events  were  identified  for  tracking  in  coordi¬ 
nation  with  the  installation.  VDMTS  systems  were  mounted  on  training 
vehicles.  After  the  training  event,  VDMTS  hardware  was  removed  from  the 
vehicles.  VDMTS  data  were  processed  through  the  models  and  the  results 
summarized.  Events  were  tracked  at  Fort  Riley,  Fort  Benning,  and 
Pohakuloa  Training  Area.  A  total  of  14  events  were  tracked  (136  vehicles 
across  nine  vehicle  types).  (Appendix  B  includes  a  comprehensive  table  of 
vehicles  tracked  by  date  and  location.)  VDMTS  live  training  data  combined 
with  accuracy  demonstrated  were  compared  to  input  resolution  thresholds 
established  for  the  Fort  Riley  nLS  model  and  ATTACC  methodology. 

It  was  assumed  that,  if  the  VDMTS  system  met  this  defined  metric,  the  da¬ 
ta  quality  was  sufficient  for  parameterization  of  models. 

3.8.2  Metric  8.2:  Ability  to  use  data  to  identify  training  area  use  patterns 

The  objective  of  this  metric  was  to  determine  if  the  data  quality  was  suffi¬ 
cient  to  identify  training  area  use  patterns.  Identifying  training  area  use 
patterns  assists  installation  land  managers  in  identifying:  LRAM  sites,  low 
water  crossing  usage,  emerging  trails,  and  impact  to  TES  habitats  (e.g., 
Red-cockaded  Woodpecker  [RCW]  and  Gopher  Tortoise).  As  described  for 
Metric  3.1,  vegetation  loss  used  in  this  demonstration  was  calculated  using 
the  theoretical  impact  models.  Previously  demonstrated  positional  accura¬ 
cy  combined  with  positional  accuracy  from  this  study  was  compared  with 
data  requirements  to  determine  applicability  of  system  for  different  land- 
use  decisions. 

Vehicle  positional  accuracy  is  required  for  all  training  use  pattern  identifi¬ 
cation.  Some  pattern  identification  (e.g.,  LRAM  site  identification)  require 
vegetation  loss  predictions  (from  previously  validated  models).  Current 
methods  of  LRAM  site  identification  require  feedback  from  units  after 
training  events  and  accuracy  is  lacking.  Consultation  with  Fort  Riley  land 
managers  established  a  vegetation  loss  accuracy  requirement  of  <20%  for 
LRAM  site  identification.  Identifying  low  water  crossing  usage  and  emerg¬ 
ing  trails  allows  resources  to  be  focused  on  regions  with  higher  usage  in¬ 
tensity.  Fort  Riley  ITAM  personnel  also  expressed  an  interest  in  combin¬ 
ing  VDMTS  obtained  vehicle  positional  data  with  available  National 
Geospatial  Intelligence  Agency  (NGA)  multispectral  and  panchromatic 
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satellite  images  to  help  extrapolate  installation  wide  training  impacts.  The 
resolution  of  these  images  is  0.5  -  2.5  m.  Fort  Riley  GIS  technicians  estab¬ 
lished  a  vehicle  positional  accuracy  requirement  of  <10  m.  This  use  of 
VDMTS  data  is  applicable  across  all  installations  as  these  satellite  images 
can  be  obtained  anywhere  in  the  continental  United  States. 

The  knowledge  of  vehicle  movement  relative  to  known  RCW  cavity  trees 
and  Gopher  Tortoise  burrows  is  desired  for  proper  management  of  these 
species  on  installations.  VDMTS  data  allows  determination  of  adherence 
to  RCW  cavity  tree  avoidance  guidelines.  Vehicle  positional  data  can  be 
analyzed  with  respect  to  RCW  behavioral  responses  (e.g.,  flushing  or  feed¬ 
ing).  The  probability  distribution  of  the  vehicle  location  and  location  of 
sensitive  habitats  allows  a  determination  of  negative  impacts  per  distance 
traveled.  Through  consultation  with  US  Fish  and  Wildlife,  a  vehicle  posi¬ 
tional  accuracy  requirement  of  <5  m  was  established  for  assessing  TES 
habitat  impacts. 

The  metric  was  tested  by  performing  routine  data  analyses  following  train¬ 
ing  events.  Live  training  events  were  identified  for  tracking  in  coordination 
with  the  installation  to  best  address  the  training  use  patterns  desired. 
VDMTS  systems  were  mounted  on  training  vehicles.  After  the  training 
event,  VDMTS  hardware  was  removed  from  the  vehicles.  VDMTS  data 
were  analyzed  and  results  summarized.  Events  were  tracked  at  Fort  Riley, 
Fort  Benning,  and  Pohakuloa  Training  Area.  A  total  of  14  events  were 
tracked  (136  vehicles  across  nine  vehicle  types).  (Appendix  B  includes  a 
comprehensive  table  of  vehicles  tracked  by  date  and  location.)  Results 
were  evaluated  to  test  the  hypothesis  that  vehicle  positional  accuracy 
demonstrated  was  statistically  within  the  success  criteria  established. 

It  was  assumed  that,  if  the  VDMTS  system  met  this  defined  metric,  the  da¬ 
ta  were  accurate  enough  to  identify  training  area  use  patterns. 

3.9  Performance  Objective  9  (qualitative):  Ease  of  system  use 

3.9.1  Metric  9.1:  Ability  of  a  technician-level  individual  to  install,  remove, 
and  review  collected  data 

The  objective  of  this  metric  was  to  determine  the  effort  required  to  train  a 
technician  in  VDMTS  operation  and  actually  perform  tracking  events  and 
data  analyses.  To  assess  this  qualitative  metric,  feedback  was  obtained  from 
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the  trained  technician  on  the  utility  and  sufficiency  of  the  training  and 
VDMTS  process  in  the  form  of  a  questionnaire  and  evaluation  form.  The 
metric  was  tested  by  training  one  or  more  technicians  at  each  installation 
(Fort  Riley,  Fort  Benning,  and  Pohakuloa  Training  Area)  in  use  of  VDMTS 
process.  Live  training  events  were  identified  for  tracking  in  coordination 
with  the  installation.  Installation  level  technicians  performed  all  steps  of  the 
VDMTS  process  (installation  and  use  of  VDMTS  hardware,  QA/QC  of  data, 
and  VDMTS  data  summary).  A  total  of  14  events  were  tracked. 

An  evaluation  form  was  given  to  technicians  to  qualitatively  and  quantita¬ 
tively  assess  ease  of  system  use  and  ability  to  make  land-use  decisions 
based  on  process  results  (Appendix  D).  Technicians  only  filled  in  the  eval¬ 
uation  sections  relating  to  their  experience  with  the  system.  One  section 
allowed  the  user  to  give  a  1-10  ranking  for  each  of  the  steps  in  the  VDMTS 
data  collection,  QA/QC,  and  analysis  processes.  A  ranking  of  10  indicated 
no  issues  with  that  step  while  a  ranking  of  1  indicated  an  unusa¬ 
ble/difficult  step.  Comments  on  each  step  were  also  requested.  A  set  of 
general  questions  were  asked.  Six  installation  technicians  were  given  the 
evaluation  following  their  training  and  use  of  the  system.  Since  this  was  a 
small  sample,  four  additional  students  from  the  University  of  Illinois  and 
University  of  Tennessee,  Knoxville  were  trained  and  asked  to  evaluate  the 
system  and  training.  The  students  were  of  B.S.  and  M.S.  backgrounds  in 
similar  fields  of  study  as  military  installation  technicians. 

It  was  assumed  that  an  average  ranking  >7  indicated  no  issues  with  that 
particular  step  in  the  VDMTS  process. 

3.10  Performance  Objective  10  (qualitative):  Quality  and  accuracy  of 
data  for  land-use  decisions 

3.10.1  Metric  10.1:  Ability  to  use  data  for  parameterization  and  identify 
training  area  use  patterns 

The  objective  of  this  metric  was  to  determine  if  the  data  quality  was  suffi¬ 
cient  use  as  inputs  in  various  predictive  models  and  to  identify  training 
area  use  patterns.  Land  manager  and  researcher  feedback  was  required  to 
determine  if  VDMTS  obtained  datasets  were  actionable  information.  The 
metric  was  tested  by  training  one  or  more  technicians  at  each  installation 
(Fort  Riley,  Fort  Benning,  and  Pohakuloa  Training  Area)  to  analyze 
VDMTS  data  and  summarize  them  into  useable  forms.  Live  training  events 
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were  identified  for  tracking  in  coordination  with  the  installation.  Installa¬ 
tion  level  technicians  performed  all  steps  of  the  VDMTS  process  (data  pro¬ 
cessing,  analysis,  and  summary). 

Technicians  were  given  an  evaluation  form  to  qualitatively  and  quantita¬ 
tively  assess  ease  of  system  use  and  ability  to  make  land-use  decisions 
based  on  process  results  (Appendix  D).  Technicians  only  filled  in  the  eval¬ 
uation  sections  relating  to  their  experience  with  the  system.  One  section 
allowed  the  user  to  give  a  1-10  ranking  for  each  of  the  steps  in  the  VDMTS 
data  collection,  QA/QC,  and  analysis  processes.  A  ranking  of  10  indicated 
no  issues  with  that  step  while  a  ranking  of  l  indicated  an  unusa¬ 
ble/difficult  step.  Comments  on  each  step  were  also  requested.  A  set  of 
general  questions  were  asked.  Six  installation  technicians  were  given  the 
evaluation  following  their  training  and  use  of  the  system.  Since  this  is  a 
small  sample,  four  additional  students  from  the  University  of  Illinois  and 
University  of  Tennessee  were  trained  and  asked  to  evaluate  the  system  and 
training.  The  students  were  of  B.S.  and  M.S.  backgrounds  in  similar  fields 
of  study  as  military  installation  technicians.  It  was  assumed  that  an  aver¬ 
age  ranking  >7  indicated  no  issues  with  that  particular  step  in  the  VDMTS 
process. 
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4  Site  Description 

This  chapter  provides  a  short  description  of  the  selected  demonstration 
sites.  The  two  main  demonstration  sites  were  Fort  Riley,  KS  and  Fort 
Benning,  GA.  Additional  studies  were  performed  at  Eglin  AFB,  FL  and 
Pohakuloa  Training  Area,  HI. 

4.1  Site  selection 

For  this  study,  Fort  Riley  was  considered  the  alpha  test  site.  Fort  Riley  da¬ 
ta  were  used  in  original  impact  model  development  and  concept  develop¬ 
ment.  As  such,  use  of  impact  models  at  this  location  provided  a  test  of  the 
models/technology  within  the  model  development  parameters.  Fort  Riley 
also  represents  a  less  stressing  environment  in  that  it  is  relatively  flat  open 
grasslands  with  little  GPS  signal  interference. 

Fort  Benning  was  considered  the  beta  test  site.  No  data  from  Fort  Benning 
were  used  in  the  development  of  the  model.  As  such,  this  demonstration 
site  represents  an  evaluation  of  the  models/technology  outside  the  original 
bounds  of  model  development.  Fort  Benning’s  topography  and  vegetation 
are  more  diverse  allowing  for  a  more  robust  evaluation  of  the  VDMTS 
GPS/INS  tracking  capabilities.  Fort  Benning  was  included  to  allow  use  of 
model/technology  output  with  other  SERDP/ESTCP  investments. 

Eglin  AFB  was  chosen  as  an  alternative  site  for  Fort  Benning  for  the  con¬ 
trolled  vehicle  impact  test  since  the  cost  to  perform  the  study  at  Fort 
Benning  was  prohibitive.  Eglin  AFB  was  selected  as  an  alternative  site  for 
its  similar  soil  and  vegetation  conditions. 

Installation  land  managers  at  Pohakuloa  Training  Area  expressed  interest 
in  using  the  VDMTS  system  to  identify  vehicle  impacts  in  the  newly 
opened  Keamuku  Training  Area.  This  location  allowed  the  system  to  be 
tested  and  validated  under  different  conditions  and  on  different  vehicle 
types. 

The  combination  of  the  four  sites  provides  a  broad  range  of  site  character¬ 
istics  (topography,  soil,  and  vegetation),  vehicle  types,  and  training  doc¬ 
trine. 
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4.2  Site  location,  history,  and  site  characteristics 

4.2.1  Fort  Riley,  KS 

Fort  Riley,  which  is  located  in  northeastern  Kansas  (Figure  8),  has  an  area 
of  41,154  ha.  It  is  located  in  the  Bluestem  Prairie  region,  is  characterized 
by  rolling  plains,  and  is  dissected  by  stream  valleys.  Installation  lands  are 
a  mix  of  native  prairie  and  introduced  vegetation.  Fort  Riley  is  located 
within  a  1.6  million  ha  region  in  eastern  Kansas  containing  the  largest  un¬ 
tilled  tallgrass  prairie  landscape  in  the  world  (Knapp  and  Seastedt  1998). 
Tall  grasses  dominate  this  area  and  wood  and  shrub  lands  occur  mainly  in 
the  stream  valleys  (Althoff  and  Thien  2005).  There  are  three  major  vegeta¬ 
tion  communities  on  Fort  Riley:  grasslands  (ca.  32,200  ha),  shrublands 
(ca.  1600  ha),  and  woodlands  (ca.  6000  ha).  Grasslands  are  dominated  by 
big  bluestem  ( Andropogon  gerardii ),  Indiangrass  ( Sorghastrum  nutans ), 
switchgrass  ( Panicum  virgatum ),  and  little  bluestem  ( Schizachyrium 
scoparium )  with  other  grasses  and  forbs  occurring  in  lesser  abundance. 
Shrublands  are  dominated  by  buckbrush  ( Symphoricarpos  orbiculatas), 
smooth  sumac  ( Rhus  glabra ),  and  rough-leaved  dogwood  ( Cornus 
drummondii )  with  a  mixture  of  grasses  and  forbs.  Shrublands  occur  along 
woodland  edges  and  in  isolated  patches  in  grassland  areas. 


Study  area  and  land  cover  categories 


Figure  8.  Fort  Riley  controlled  field  study  and  live  training  event  study  locations. 
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Woodlands  typically  occur  along  riparian  lowlands  and  are  characterized 
by  chinquapin  oak  ( Quercus  muhlenbergii ),  bur  oak  ( Quercus  macrocar- 
pa),  American  elm  ( Ulmus  americana),  hackberry  ( Celtis  occidentalis), 
and  black  walnut  (Jug Ians  nigra). 

Since  the  early  1940s,  a  variety  of  military  training  activities  including  field 
maneuvers,  combat  vehicle  operations,  mortar  and  artillery  fire,  and 
small-arms  fire  have  taken  place  at  Fort  Riley.  These  activities  have  affect¬ 
ed  the  ecosystem  processes,  including  disturbing  ground  and  vegetation 
cover;  increasing  soil  erosion;  changing  plant  composition,  vegetation 
structures,  habitats,  and  biodiversity;  and  landscape  fragmentation. 

The  majority  of  mechanized  maneuver  activities  has  occurred  on  the 
northern  75%  portion  of  Fort  Riley  (17  of  the  18  designated  training  areas 
ranging  from  577-3,024  ha)  for  the  past  4  decades.  Typical  maneuvers  by 
large  tracked  and  wheeled  vehicles  that  traverse  thousands  of  hectares  in  a 
single  training  exercise  can  cause  impacts  ranging  from  minor  soil  com¬ 
paction  and  lodging  of  standing  vegetation  to  severe  compaction  and  com¬ 
plete  loss  of  vegetative  cover  in  areas  with  concentrated  training  use.  Wild¬ 
fires  resulting  from  training  activities  may  occur  during  any  season  on  the 
installation. 

Figure  8  shows  the  study  areas  at  Fort  Riley.  The  controlled  field  study  site 
location  was  selected  to  allow  the  study  access  to  installation  representa¬ 
tive  soil  and  vegetation  types  without  conflicting  with  ongoing  training  ac¬ 
tivities.  The  live  training  event  study  site  location  identifies  the  region 
most  commonly  used  by  maneuver  training  events. 

4.2.2  Fort  Benning,  GA 

Fort  Benning,  which  is  located  in  southwest  Georgia  (Figure  9),  is  73,503 
ha  in  size.  Most  of  the  installation  lies  in  west  central  Georgia,  but  a  small 
part  extends  into  Russell  County,  AL.  Long,  hot  summers  and  mild  winters 
characterize  the  region’s  climate.  Average  annual  precipitation  is  approx¬ 
imately  740  mm  with  a  monthly  average  of  about  62  mm.  Most  of  the  pre¬ 
cipitation  occurs  in  the  form  of  spring  and  summer  thunderstorms.  Heavy 
rains  are  typical  during  the  summer,  but  can  occur  in  any  month.  Snow 
accounts  for  less  than  1%  of  the  annual  precipitation. 
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i  Live  Event  Study 


Figure  9.  Fort  Benning  controlled  field  study  and  live  training  study  locations. 


The  installation  is  situated  on  the  Fall  Line  transition  zone,  which  is  the 
geographic  area  between  the  Southern  Appalachian  Piedmont  and  the 
Coastal  Plain.  Soils  are  composed  of  clay  beds,  weathered  Coastal  Plain 
material,  and  alluvial  deposits  from  the  Piedmont  (Knowles  and  Davo 
1997).  Fort  Benning  is  classified  as  a  southeastern  Mixed  Forest  Province 
of  the  Subtropical  Division  (Bailey  1995).  This  region  is  characterized  by 
second  growth  pine  forests  of  longleaf  (Pinus  palustris),  loblolly  ( Pinus 
taeda ),  and  slash  pines  (Pinus  elliotii).  Patchy  land  cover  forming  a  mosaic 
of  open  or  forested  areas  characterizes  the  installation. 

Open  areas  are  used  for  military  training  or  managed  for  wildlife  openings. 
The  military  open  areas  are  frequently  clear-cut  parcels  of  land  dominated 
by  grass  and  bare  soil.  Since  the  early  1920s,  land  impacts  due  to  light  and 
heavy  military  activities  (e.g.,  infantry,  artillery,  wheeled,  and  tracked  ve¬ 
hicle  training)  frequently  occur  in  open  areas.  Because  of  the  Base  Rea¬ 
lignment  and  Closure  Commission  (BRAC),  the  US  Army  Armor  Center 
and  School  is  currently  being  relocated  to  Fort  Benning.  This  realignment 
will  result  in  heavier  military  training  than  has  historically  occurred  on  the 
installation,  especially  in  the  southern  Good  Hope  Maneuver  Area. 
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Figure  9  shows  the  study  areas  at  Fort  Benning.  The  live  training  event 
study  site  location  identifies  two  regions  most  commonly  used  by  maneu¬ 
ver  training  events.  One  location  is  of  primary  interest  to  the  ITAM  com¬ 
munity  (southwest  area)  due  to  erosion  issues.  One  location  is  of  primary 
interest  to  the  conservation  community  (northeast  area)  due  to  potential 
training  conflicts  with  RCW  habitat. 

4.2.3  Eglin  AFB,  FL 

Eglin  AFB  is  located  on  the  Florida  panhandle  (Figure  10).  Due  to  prohibi¬ 
tive  costs  at  Fort  Benning,  Eglin  AFB  was  selected  for  the  controlled  study 
for  this  demonstration  under  ESTCP  guidance.  It  is  the  largest  forested  mili¬ 
tary  reservation  in  the  United  States  consisting  of  187,995  ha  within  Santa 
Rosa,  Okaloosa,  and  Walton  counties  (US  Air  Force  2010).  Eglin  AFB  has  a 
subtropical  climate  characterized  by  humid  warm  summers  and  mild  win¬ 
ters.  However,  the  northern  portion  of  the  base  has  more  of  a  continental 
climate  than  subtropical  as  its  distance  from  the  Gulf  reduces  the  moderat¬ 
ing  effect.  A  majority  of  the  soils  on  Eglin  AFB  belong  to  the  Lakeland  Asso¬ 
ciation  with  Lakeland  Sand  the  dominate  soil  type.  Doravan  mucks  are  in 
the  Lakeland  Association  and  are  the  second  most  abundant  soil  on  Eglin 
AFB.  Eglin’s  sandhills  are  comprised  of  old  growth  longleaf  pine  forests  with 
grasses,  forbs  and  low  stature  shrub  groundcover.  This  structure  is  main¬ 
tained  by  frequent  fires  (3-5  year  frequency).  Eglin  AFB  is  the  largest  and 
least  fragmented  single  longleaf  pine  ownership  in  the  world. 
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4.2.4  Pohakuloa  Training  Area,  HI 


Pohakuloa  Training  Area  (PTA)  is  located  on  the  island  of  Hawaii  ( 
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Figure  n).  It  is  53,735  ha  in  size  making  it  the  largest  Army  training  area 
in  Hawaii  (US  Army  Environmental  Command  2008).  The  installation  is 
located  in  the  saddle  between  Mauna  Loa  and  Mauna  Kea  volcanoes.  The 
climate  at  PTA  is  classified  as  cool  and  tropical  with  an  annual  mean  tem¬ 
perature  ranging  from  10-16  °C  depending  on  the  elevation  (US  Depart¬ 
ment  of  the  Army  2002).  Diurnal  temperature  fluctuations  are  greater 
than  seasonal  variations.  The  mean  annual  precipitation  ranges  from  10- 
41  cm  across  the  installation  with  the  highest  monthly  precipitation  occur¬ 
ring  in  the  winter  months.  PTA  is  located  in  the  Hawaiian  Islands  Province 
of  the  Rainforest  Division  (Bailey  1995).  Soils  on  PTA  are  thin  and  poorly 
developed.  The  predominant  soil  types  are  Keekee  loamy  sand  and 
Kilohana  loamy  fine  sand,  formed  in  volcanic  ash,  sand,  and  cinders. 
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Controlled  Event  Study  Site 
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Figure  10.  Eglin  AFB  controlled  field  study  location. 
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Figure  11.  PTA  controlled  field  study  and  live  training  event  study  locations. 
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Recent  lava  flows  cover  approximately  80%  of  the  surface.  Vegetative  cov¬ 
er  is  largely  a  function  of  the  age  of  the  lava  flow  on  which  it  grows  and 
varies  tremendously.  Lichens  (e.g.,  Stereocoulon  vulcani )  and  ferns  (e.g., 
Pella  trenifolia )  are  generally  early  colonizers  of  lava  flows.  Additionally, 
grassland,  shrubland,  and  treeland  make  up  the  vegetation  communities  at 
PTA.  Grassland  is  composed  of  native  grasses  (e.g.,  Eragrostis 
atropioides,  Trisetum  glomeratum,  and  Panicum  tenuifolium )  and  inva¬ 
sive  fountain  grass  ( Pennisetum  setaceum).  Shrubland  is  dominated  by 
Dodonaea  viscosa  and  Myoporum  sandwicense  with  forb  and  grass  un¬ 
derstory  species.  Treeland  vegetative  communities  are  characterized  by  a 
Metrosideros  polymorpha  dominated  overstory  with  a  Dodonaea  viscosa 
and  Styphelia  tameiameiae  shrub  understory. 

PTA  is  used  for  maneuver  unit  live  fire,  maneuver  training,  and  artillery 
live  fire  (US  Department  of  the  Army  2002).  Approximately  12,950  ha  are 
suitable  for  maneuver  training.  It  is  the  only  training  area  in  Hawaii  capa¬ 
ble  of  supporting  coordinated  live  firing  from  assigned  crew-served  vehi¬ 
cles  of  the  infantry  and  artillery  in  conjunction  with  live  air  support.  In 
2006,  the  9210  ha  Keamuku  Training  Area  was  added  to  PTA  to  support 
battalion  maneuver  training  and  to  support  training  of  the  Stryker  Brigade 
Combat  Teams. 
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Figure  n  shows  the  study  areas  at  PTA.  Controlled  and  live  training  events 
were  tracked  in  these  areas.  The  field  study  site  locations  were  selected 
through  coordination  with  PTA  installation  land  managers.  The  Controlled 
Event  study  site  was  located  in  the  recently  acquired  Keamuku  parcel.  This 
area  was  of  most  concern  to  the  installation  land  managers  as  it  was  re¬ 
cently  opened  for  Stryker  Brigade  maneuver  training.  Training  monitored 
under  the  live  event  study  occurred  all  throughout  PTA  including  the 
Keamuku  Training  Area. 
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5  Test  Design 

This  chapter  provides  a  description  of  the  demonstration  design,  which 
was  intended  to  assess  performance  objectives  listed  in  Table  3  (p  22). 

5.1  Conceptual  test  design 

This  section  provides  a  broad  overview  of  the  test  design  used  to  evaluate 
the  performance  objectives.  Figure  12  shows  the  conceptual  demonstration 
plan.  The  two  main  demonstration  sites  were  Fort  Riley,  KS  and  Fort 
Benning,  GA.  Fort  Riley  was  considered  an  alpha  test  site.  Fort  Riley  data 
were  used  in  original  impact  model  development  and  concept  develop¬ 
ment.  As  such,  use  of  impact  models  at  this  location  was  a  test  of  the  mod¬ 
els  within  the  range  of  conditions  used  in  model  development.  Fort  Riley 
personnel  were  more  familiar  with  the  approach  since  they  had  already 
seen  data  collected  from  the  system  in  the  past. 


Figure  12.  Conceptual  demonstration  plan. 
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Fort  Benning  was  considered  a  beta  test  site.  No  data  from  installations  in 
the  Southeast,  including  Fort  Benning,  were  used  in  model  development.  As 
such,  this  demonstration  site  represented  an  evaluation  of  the  models  out¬ 
side  the  bounds  of  model  development.  Fort  Benning  personnel  were  also 
unfamiliar  with  the  approach  since  they  had  not  seen  data  from  the  system 
in  the  past.  Fort  Benning  was  included  to  allow  use  of  model/technology 
output  with  other  SERDP/ESTCP  investments.  Eglin  AFB,  FL  was  selected 
as  a  substitute  for  the  controlled  study  at  Fort  Benning  under  ESTCP  guid¬ 
ance.  Additionally,  installation  land  managers  at  PTA  expressed  interest  in 
using  the  VDMTS  system  to  identity  vehicle  impacts  in  the  newly  opened 
Keamuku  Training  Area.  This  location  allowed  the  system  to  be  tested  and 
validated  under  different  conditions  and  on  different  vehicle  types. 

The  demonstration  plan  consisted  of  first  verifying  that  the  hardware  was 
properly  recording  vehicle  dynamic  and  static  properties  for  use  in  subse¬ 
quent  tests.  Tests  were  conducted  for  location,  velocity,  turning  radius, 
and  GPS  signal  loss  (forcing  INS  system  performance).  The  hardware  sys¬ 
tem  tests  were  conducted  at  the  University  of  Tennessee.  Results  are  ap¬ 
plicable  to  all  demonstration  sites. 

The  second  test  consisted  of  demonstrating/validating  the  impact  models. 
Vehicles  of  different  static  properties  (weight,  track/ wheel)  were  driven 
through  defined  courses  causing  variance  in  vehicle  dynamic  properties  (ve¬ 
locity,  turning  radius).  Tracking  units  were  used  to  capture  vehicle  dynamic 
properties  and  impact  models  were  used  to  predict  site  impact  (DW,  vegeta¬ 
tion  cover,  rut  depth).  Field  measurements  of  site  impacts  were  used  to  as¬ 
sess  impact  model  performance.  The  controlled  study  to  validate  impact 
models  was  conducted  at  Fort  Riley,  Eglin  AFB,  and  PTA.  Due  to  the  inabil¬ 
ity  to  access  vehicles  at  Fort  Benning,  Eglin  AFB  was  chosen  as  a  substitute 
test  site  for  the  controlled  study  under  ESTCP  direction.  Performing  the 
study  at  Eglin  AFB  allowed  for  stressing  of  the  models  under  different  con¬ 
ditions  from  where  they  were  developed.  Furthermore,  Eglin  AFB’s  soil  type 
and  climate  were  similar  to  those  anticipated  at  Fort  Benning. 

The  third  test  consisted  of  installing  tracking  units  on  multiple  vehicles 
during  a  single  live  training  event.  On  completion  of  the  training  event, 
vehicle  dynamic  properties  and  locations  were  used  to  predict  impacts 
along  vehicle  paths.  Random  locations  were  selected  and  site  impact  data 
were  collected  to  validate  system  performance.  This  test  was  conducted  at 
Fort  Riley  and  Fort  Benning. 
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The  fourth  test  consisted  of  installing  tracking  units  on  multiple  vehicles  dur¬ 
ing  multiple  live  training  events.  On  completion  of  the  training  events,  vehicle 
dynamic  properties  and  location  were  used  to  predict  spatial  site  impacts.  Da¬ 
ta  were  summarized  to  address  one  or  more  installation-identified  land  man¬ 
agement  issues.  These  tests  were  conducted  at  Fort  Riley,  Fort  Benning,  and 
PTA.  Installation  level  technicians  were  trained  at  all  locations  on  VDMTS 
unit  use.  This  test  determined  the  ease  of  system  use  and  determined  the  ap¬ 
plicability  of  the  VDMTS  unit  to  land  management  decisionmaking. 

5.2  Baseline  characterization  and  preparation 

Baseline  characterization  and  preparation  was  essentially  the  first  test  in 
the  conceptual  demonstration  plan  (Figure  12).  Baseline  characterization 
consisted  of  verifying  that  the  hardware  functioned  properly  and  recorded 
vehicle  dynamic  and  static  properties  for  use  in  subsequent  tests.  Tests 
were  conducted  for  location,  velocity,  turning  radius  accuracy,  and  GPS 
signal  loss  (forcing  INS  system  performance).  These  baseline  tests  were 
performed  at  the  University  of  Tennessee  and  the  methods  used  are  de¬ 
scribed  in  the  following  section. 

5.3  Design  and  layout  of  technology  and  methodology  components 

5.3.1  VDMTS  hardware  positional  accuracy  test 

VDMTS  systems  were  located  on  a  known  benchmark  (assumed  location 
truth)  and  were  allowed  to  collect  a  minimum  of  GPS  position  data,  Coor¬ 
dinated  Universal  Time  (UTC)  time,  and  Horizontal  Dilution  Of  Precision 
(HDOP)  for  at  least  6  hours.  The  data  were  transferred  from  the  log  files  to 
spreadsheet  files  for  data  analysis.  The  position  data  were  converted  to  the 
Universal  Transverse  Mercator  (UTM)  coordinate  system  for  analysis.  The 
average  position  for  the  GPS  points  is  determined  by  finding  the  average  of 
the  Northing  and  Easting  coordinates.  The  position  error  (in  meters)  for 
each  point  was  calculated  using  Equation  21,  where  the  actual  known 
benchmark  position  is  denoted  as  the  B  position.  The  average  of  the  posi¬ 
tion  errors  was  determined  and  recorded: 

error  =  ^{an-bn)2  +  {ae-be)2  Eq  2l 

where: 

An  =  VDMTS  UTM  northing 
Bn  =  benchmark  UTM  northing 
Ae  =  benchmark  UTM  easting. 
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The  Circular  Error  Probable  (CEP)  is  the  distance  of  GPS  error  that  en¬ 
closes  50%  of  the  data  points.  The  CEP  was  determined  from  position  er¬ 
ror  data  by  determining  the  error  distance  that  includes  50%  of  the  posi¬ 
tion  error  distances.  The  Twice  Distance  Root  Mean  Square  (2DRMS)  is 
the  distance  of  GPS  error  that  encloses  95%  of  the  data  points’  two  stand¬ 
ard  deviations.  The  2DRMS  distance  was  determined  from  the  position 
error  data  by  finding  the  distance  that  includes  95%  of  the  position  error 
distances.  The  HDOP  describes  the  clarity  of  which  the  GPS  position  can 
be  determined.  A  high  HDOP  indicates  a  higher  uncertainty  of  position. 
The  average  HDOP  was  calculated  from  the  recorded  HDOP.  These 
measures  of  GPS  error  are  measures  commonly  reported  for  GPS  systems. 

Several  controls  were  used  in  this  test:  (1)  high-resolution,  high-cost  GPS 
only  system,  (2)  low-cost,  low  resolution  GPS  only  system  commonly  used 
in  self  made  vehicle-tracking  units,  (3)  GPS/INS  tracking  hardware  from 
another  commercial  vendor.  These  three  controls  bound  the  potential  im¬ 
plementation  of  the  impact  models.  Control  1  (high-resolution,  high-cost 
GPS  only  system)  optimized  position  accuracy  with  no  GPS  tracking  sys¬ 
tem  cost  constraints.  Control  2  (low-cost,  low  resolution  GPS  only  system 
commonly  used  in  self  made  vehicle-tracking  units)  provided  comparison 
of  using  impact  models  with  self  constructed  tracking  units.  Control  3 
(GPS/INS  tracking  hardware  from  another  commercial  vendor)  served  as 
a  reference  point  for  other  GPS/INS  systems  in  the  marketplace. 

The  demonstration  metric  was  unit  location  within  5  m  (16.4  ft)  of  truth. 
This  value  was  based  on  obtaining  a  location  value  more  precise  than  is 
required  for  impact  summaries  and  balancing  VDMTS  positional  accuracy 
with  cost  constraints. 

5.3.2  VDMTS  hardware  velocity  accuracy  test 

The  VDMTS  tracking  units  were  mounted  on  a  vehicle  that  was  driven  at 
three  different  (but  constant)  velocities  along  a  track  of  known  GPS  coor¬ 
dinates.  The  velocity  of  the  vehicle  was  determined  by  timing  the  vehicle 
with  a  stopwatch  over  a  predetermined  distance.  The  timed  velocity  was 
assumed  to  be  truth.  The  velocity  was  also  calculated  from  GPS/INS  data 
by  determining  the  change  in  position  data  of  the  vehicle.  The  same  three 
controls  used  in  the  location  test  were  also  used  in  the  velocity  test  for 
comparison  purposes. 
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The  demonstration  metric  was  unit  velocity  within  2.24  m/s  (5  mph)  of 
truth.  This  value  was  based  on  obtaining  a  velocity  value  more  precise  than 
is  required  for  impact  summaries  and  balancing  VDMTS  positional  accu¬ 
racy  with  cost  constraints. 

5.3.3  VDMTS  hardware  turning  radius  accuracy  test 

The  VDMTS  tracking  units  were  mounted  on  a  vehicle  that  was  driven 
around  several  constant  radius  courses  (differing  radii)  and  along  a 
straight  path  multiple  velocities.  The  distance  from  the  center  pivot  to 
each  of  the  course  paths  was  used  as  the  actual  radius  (truth)  and  was 
compared  to  the  radius  values  calculated  from  the  position  data  provided 
by  the  units.  The  same  three  controls  used  in  the  location  test  were  also 
used  in  the  velocity  test  for  comparison  purposes. 

The  demonstration  metric  was  unit  turning  radius  within  10  m  (32.8  ft)  of 
truth.  This  value  was  based  on  obtaining  a  turning  radius  value  more  pre¬ 
cise  than  required  for  impact  summaries  and  balancing  VDMTS  positional 
accuracy  with  cost  constraints. 

5.3.4  VDMTS  hardware  INS  system  test 

The  INS  subsystem  of  the  VDMTS  tracking  system  is  designed  to  ensure 
vehicle  location  and  dynamic  property  values  during  periodic  GPS  signal 
loss  or  loss  of  GPS  signal  quality.  The  same  three  controls  used  in  the  loca¬ 
tion  test  were  used  in  the  velocity  test  for  the  same  comparison  purposes. 
Tracking  units  were  mounted  on  a  vehicle  that  is  driven  through  tunnels, 
vegetation,  and  other  areas  of  poor  or  no  GPS  signal.  The  location,  veloci¬ 
ty,  and  turning  radius  along  the  course  with  and  without  signal  were  rec¬ 
orded. 

The  demonstration  metric  was  location,  velocity,  and  turning  radii  for  are¬ 
as  of  no  or  low  GPS  signal  quality.  This  was  essentially  a  preliminary  test 
to  ensure  the  INS  system  was  functioning  properly.  A  test  of  the  value  of 
having  INS  included  in  the  VDMTS  is  in  Section  5.4.2,  “Live  training  test— 
Model  validation.” 
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5.4  Field  testing 

5.4.1  Controlled  impact  model  validation  study 

A  series  of  field  studies  were  conducted  using  multiple  vehicles  (MiAi 
Abrams  Tank,  Armored  Personnel  Carrier  (APC)-Mii3,  M2A2  Bradley, 
High-Mobility  Multipurpose  Wheeled  Vehicle  (HMMWV),  HEMTT,  and 
Stryker  Light  Armored  Vehicle  (LAV)  III)  (Table  4).  These  vehicles  cov¬ 
ered  a  range  of  tracked  (light  to  heavy)  and  wheeled  vehicles  (light  to 
heavy  and  multiple  axles).  Since  the  impact  models  were  designed  for  use 
with  various  types  of  vehicles  and  incorporate  vehicle  static  properties 
(weight,  track/ wheel),  vehicles  that  represent  a  range  in  vehicle  static 
properties  were  appropriate  for  model  validation  testing. 

Each  vehicle  was  driven  on  a  systematically  planned  course  (spiral)  within 
a  randomly  located  treatment  plot  (Figure  13).  Each  vehicle  tracked  three 
treatment  plots  (replication).  Each  spiral  course  within  a  treatment  plot 
consisted  of  a  section  of  straight-line  travel  followed  by  a  section  of  con¬ 
stantly  decreasing  turning  radius.  The  spiral  was  completed  after  reaching 
the  vehicle’s  minimum  turning  radius.  One  spiral  for  each  vehicle  was 
traversed  at  a  slow  and  fast  velocity.  Actual  velocities  were  not  critical  as 
long  as  they  represent  different  velocities  for  testing  the  model  and  are 
reasonable  velocities  for  operation  of  a  vehicle  of  that  type.  The  slow  veloc¬ 
ity  typically  represented  an  average  velocity  for  off-road  travel  for  that  ve¬ 
hicle  while  the  high  velocity  condition  represented  the  maximum  velocity 
the  driver  could  safely  maneuver  the  spiral  course. 

A  VDMTS  hardware  unit  and  a  high-cost,  high-resolution  GPS  tracking  unit 
were  mounted  on  each  vehicle  tested.  The  high-cost,  high-resolution  GPS 
tracking  unit  was  the  same  unit  as  the  number  1  control  in  Section  5.2 
(hardware  tests,  pp  49-51).  This  control  was  to  relate  data  back  to  data  col¬ 
lected  from  hardware  tests  and  as  a  quality  control  check  on  the  VDMTS. 


Table  4.  Vehicles  tested  in  controlled  impact  study  at  each  site. 


Site 

Test  Dates 

Vehicle  Types  Tested 

Fort  Riley 

12-13  Aug  2008 

M1A1,  M113APC,  HMMWV,  HEMTT 

PTA 

6-9  Nov  2009 

Stryker  LAV  III 

Eglin  AFB 

12  May  2010 

M2A2,  HEMTT 
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Figure  13.  Field  test  study  design.  Spirals  show  vehicle  courses.  Dots  show 
measurement  plots.  Arrow  shows  an  example  of  a  sample  point.  The  line  across  the 
vehicle  track  illustrates  a  measurement  transect. 


The  exact  location  of  the  study  within  the  installation  was  determined  on 
availability  of  site,  relatively  undisturbed  soil/vegetation,  and  representa¬ 
tive  of  lands  typically  used  for  training.  Relatively  undisturbed  soil/vege¬ 
tation  was  chosen  to  allow  for  consistent  measurements  within  a  treat¬ 
ment.  The  three  demonstration  sites  (Fort  Riley,  Eglin  AFB,  and  PTA) 
ensured  testing  over  a  broad  range  of  soil/vegetation  types. 

5.4.2  Live  training  test— Model  validation 

A  field  study  was  conducted  by  tracking  a  live  training  event  using  VDMTS 
systems  at  Fort  Riley  and  Fort  Benning.  Military  training  events  were  iden¬ 
tified  through  coordination  with  installation  personnel.  The  military  train¬ 
ing  events  tracked  were  based  on  availability  of  units  training  at  the  installa¬ 
tion,  access  to  unit  equipment,  duration  of  training,  number  of  vehicles, 
types  of  vehicles,  mission  doctrine,  training  areas  scheduled,  and  installa¬ 
tion  objectives  for  study.  The  intent  of  these  selection  criteria  was  to  identify 
a  training  mission  tested  the  VDMTS  hardware  and  impact  models.  The 
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events  included:  (l)  four  vehicle  types,  (2)  on-  and  off-road  activity, 

(3)  wide  range  of  site  conditions  used,  and  (4)  5-  to  10-day  durations. 

A  number  of  vehicles  were  instrumented  (Table  5)  with  VDMTS  hardware 
at  both  sites.  Tracking  units  were  installed  in  the  motor  pool  and  removed 
after  the  event  is  completed.  VDMTS  data  were  used  to  locate  vehicle 
tracks  within  a  few  days  of  the  completion  of  training.  Sample  locations 
were  randomly  located  along  vehicle  paths.  Measurements  of  site  damage 
(DW,  vegetation  loss,  rut  depth)  were  made  at  each  sample  point  using 
methods  described  in  Section  5.5,  below.  Predicted  site  damage  (DW,  veg¬ 
etation  loss,  rut  depth)  were  compared  with  measured  site  damage  to 
quantify  the  ability  of  the  VDMTS  to  predict  overall  site  damage  for  a 
training  event. 

In  addition,  data  from  the  model  validation  live  training  test  were  used  to 
quantitatively  assess  INS  performance  without  GPS  signal.  Data  from  the 
single  event  study  were  analyzed  with  and  without  INS  data  being  forced 
to  the  GPS  signal,  which  allowed  a  measurement  of  INS  data  error  to  be 
compared  with  the  GPS  signal. 

5.4.3  Live  training  test— Multiple  events  for  system  validation 

A  field  study  was  conducted  by  tracking  a  series  of  live  training  events  us¬ 
ing  VDMTS  systems  (Table  6).  (Appendix  B  includes  a  comprehensive  ta¬ 
ble  of  vehicles  tracked  by  date  and  location.)  A  series  of  military  training 
events  were  identified  through  coordination  with  installation  personnel. 
The  military  training  events  tracked  were  based  on  an  installation  defined 
issue  that  relates  to  vehicle  impacts  on  installation  lands.  A  minimum  of 
four  training  events  were  tracked  per  installation  with  a  total  of  14  events 
tracked  over  3  years. 


Table  5.  Vehicles  tested  during  live  training  event  model  validation. 


Site 

Test  Dates 

Vehicle  Types  Tested 

#  Vehicles 
Tested 

Fort  Riley 

17-21  Aug  2009 

HMMWV,  Buffalo,  Medium  Tactical  Vehicle  (MTV) 

18 

Fort  Benning 

31  Oct  -  9  Nov  2011 

HMMWV,  Stryker  LAV  III 

20 
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Table  6.  Events  tracked  during  multiple  live  training  events  phase  of  study. 


Site 

Test  Dates 

#  Days 

Vehicle  Types* 

#  Vehicles 

Fort  Riley 

17-21  Aug  2009 

5 

HMMWV,  Buffalo,  MTV 

18 

Fort  Riley 

13-15  Jul  2010 

3 

HMMWV,  MTV 

7 

Fort  Riley 

10-17-May2011 

8 

HMMWV,  HEMTT,  LMTV 

12 

Fort  Riley 

17-22  May  2011 

6 

HMMWV,  HEMTT,  LMTV 

11 

Fort  Benning 

18-20  Oct  2010 

3 

Stryker,  Bradley 

9 

Fort  Benning 

28-29  Mar  2011 

2 

Stryker,  Bradley,  M1A1,  HMMWV 

7 

Fort  Benning 

31  Oct  -  9  Nov  2011 

10 

Stryker,  HMMWV 

20 

Fort  Benning 

9-14  Nov  2011 

6 

Stryker,  HMMWV 

22 

PTA 

6-9  Nov  2009 

4 

Stryker 

3 

PTA 

24-29  Jan  2010 

6 

AAV 

6 

PTA 

17-23  Jan  2011 

6 

AAV 

6 

PTA 

8-10 Jun  2011 

3 

AAV 

2 

PTA 

13-14  Jun  2011 

3 

AAV 

6 

PTA 

16-17  Jun  2011 

2 

AAV 

7 

*  AAV  =  Amphibious  Assault  Vehicle 

Bradley  =  American  infantry  fighting  vehicle 

HEMTT  =  Heavy  Expanded  Mobility  Tactical  Truck 

HMMWV  =  High-Mobility  Multipurpose  Wheeled  Vehicle 

LMTV  =  Light  Medium  Tactical  Vehicle 

M1A1  =  Ml  Abrams  battle  tank 

MTV  =  Medium  Tactical  Vehicle 

Stryker  =  A  family  of  eight-wheeled,  4-wheel-drive  (8x4),  armored  fighting  vehicles 

Prior  to  the  first  field  event,  installation  technical  staffs  were  trained  on: 
(l)  installation  and  use  of  VDMTS  hardware,  (2)  QA/QC  of  VDMTS  data, 
and  (3)  analysis  of  VDMTS  data.  During  the  training  courses,  training 
times  were  recorded  for  each  activity.  The  contents  of  the  training  courses 
are  outlined  on  below.  The  User’s  Manual  (included  in  the  Appendix  C) 
gives  more  detailed  descriptions  of  hardware  and  software  use,  trouble¬ 
shooting,  and  post  processing  of  the  VDMTS  data.  Installation  technical 
staff  were  given  these  VDMTS  user  manuals,  which  describe  every  aspect 
of  the  program: 

•  Installation  and  use  of  VDMTS  Hardware: 

1.  Proper  installation  of  the  VDMTS  unit  including  proper  unit  orienta¬ 
tion  and  mounting  locations  on  military  vehicles 

2.  Test  documentation  -  Recording  VDMTS  number  and  vehicle  number, 
type,  and  mission  on  vehicle-tracking  sheet 
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3.  VDMTS  unit  operation  in  both  logging  modes,  Auto  (Default)  and 
Manual  Logging 

4.  VDMTS  unit  shutdown  and  documentation  (record  flashing  lights  and 
battery  voltage) 

5.  Downloading  data  from  VDMTS  (via  Universal  Serial  Bus  [USB]  cable 
or  Secure  Digital  [SD]  card  removal) 

6.  VDMTS  unit  maintenance  (e.g.,  checking  battery  voltage  levels,  charg¬ 
ing  batteries,  replacing  parts) 

7.  VDMTS  unit  troubleshooting. 

•  QA/QC  of  VDMTS  Data: 

1.  Opening  of  archive  file  (.vdm)  file  on  computer  to  verily  completeness 
(Examining  start  and  stop  times  to  make  sure  file  is  complete  -  size  of 
the  file  can  be  an  indication  of  logging  times) 

2.  Proper  format  of  archive  file  (.vdm)  file  and  recognition  of  corrupted 
file 

3.  Confirming  that  adequate  vehicle  positional  accuracy  was  obtained 

4.  Installation  of  VDMTS  software 

5.  Processing  raw  archive  file  (.vdm)  files  to  read  inertial  and  GPS  data 
strings. 

•  Analysis  of  VDMTS  Data: 

1.  Processing  data  to  determine  vehicle  velocity  and  turning  radius 

2.  Converting  to  UTM  (meters),  determining  velocity  and  distance  trav¬ 
eled  from  GPS  point  movement,  determining  turning  radius  using  3- 
point  method 

3.  Using  vehicle  position,  velocity,  and  turning  radius  data  to  calculate 
impact  severity,  DW,  vegetation  removal,  and  off-road  time  depending 
on  user  needs 

4.  Compiling  and  summarizing  findings  in  a  useable  format 

5.  VDMTS  software  and  data  troubleshooting. 

For  each  training  event,  approximately  10-20  vehicles  were  instrumented 
and  tracked  depending  on  the  training  event  selected  and  the  number  of 
vehicles  in  each  event.  In  several  events,  the  total  number  of  vehicles  was 
fewer  than  10  so  all  vehicles  were  tracked.  Selection  of  vehicles  for  tracking 
was  based  on  input  from  installation  military  and  natural  resources  per¬ 
sonnel.  Military  personnel  provided  input  on  vehicle  use  as  related  to  doc- 
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trine.  Natural  resources  personnel  helped  relate  vehicle  selection  to  natu¬ 
ral  resource  decisionmaking  issues.  Several  uses  for  VDMTS  derived  data 
at  both  installations  are  described  at  the  end  of  this  section.  Tracking  units 
were  installed  in  the  motor  pool  before  each  event.  Units  were  installed 
according  to  the  VDMTS  User’s  Manual.  Tracking  units  were  removed  af¬ 
ter  each  event  is  completed.  The  mounting  and  removal  times  for  VDMTS 
units  were  monitored  and  recorded.  Vehicles  were  tracked  for  the  duration 
of  the  training  event.  Training  events  were  expected  to  last  approximately 
l  week,  but  varied  by  training  mission  and  event.  There  was  no  field  data 
collection  (vegetation  loss  or  impact  severity)  associated  with  this  demon¬ 
stration  beyond  vehicle  dynamic  properties  data  and  positional  data  quali¬ 
ty  collected  by  the  VDMTS  systems.  Previous  testing  had  already  validated 
system  performance  in  terms  of  predicting  site  impacts  (Section  5.2,  p  49). 

Technician-level  individuals  performed  data  QA/QC  and  analyzed  the  data 
according  to  the  steps  listed  previously.  Technician  data  analyses  times 
were  recorded  throughout  this  process.  Data  were  compiled  and  summa¬ 
rized  to  aid  in  land  management  decisions  or  to  parameterize  related 
models  as  described  in  Sections  3.8  (p  32)  and  3.10  (p  36). 

At  Fort  Riley,  these  data  aided  in  the  identification  of  LRAM  sites,  low  wa¬ 
ter  crossing  usage,  and  emerging  trails.  This  allowed  resources  to  be  fo¬ 
cused  on  regions  with  more  intense  usage.  An  ESTCP  project  titled  “Kine¬ 
matic  wave  approach  for  rapid  soil  erosion  assessment”  has  developed  a 
Kinematic  Wave  model  currently  in  use  at  Fort  Riley  to  predict  erosion 
and  gully  formation.  By  incorporating  vegetation  removal  calculated  using 
the  VDMTS  with  existing  land-use/landcover  datasets,  predictions  that  are 
more  reliable  were  obtained  (See  description  of  Metric  3.1  in  Section  3.3 
[p  28]  for  more  details). 

For  Fort  Benning,  the  land  management  issue  was  determining  the  impact 
of  changes  in  installation  training  requirements  associated  with  BRAC  ac¬ 
tions  on  RCW  populations.  This  involved  collecting  vehicle  use  data  to 
quantity  the  amount  of  time  vehicles  trained  near  cavity  trees  and  in  forag¬ 
ing  areas.  The  use  of  the  VDMTS  data  in  this  evaluation  of  resulted  in  data 
currently  not  collected  using  traditional  field  data  collection  methods  for 
RCW  impact  assessments. 
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The  data  collected  at  PTA  were  used  to  identify  LRAM  sites  and  identify 
potential  trail  networks  for  hardening.  PTA  recently  had  opened  the 
Keamuku  Maneuver  Area  for  off-road  training.  PTA  LRAM  was  interested 
in  using  the  VDMTS  process  to  obtain  a  gross  estimation  of  Stryker  Bri¬ 
gade  impacts  to  the  maneuver  area.  Dust  and  air  quality  are  also  issues  at 
PTA.  Tracking  of  vehicles  at  PTA  allows  for  estimation  of  dust  generation 
and  comparison  against  measured  levels. 

5.5  Sampling  protocol 

5.5.1  Sampling  protocol  for  metric  evaluation 

5.5. 1.1  Controlled  event  study 

Vehicle  impacts  (i.e.,  DW,  vegetation  loss,  and  rut  depth)  were  measured 
immediately  after  tracking.  All  measurements  were  made  along  the  outer 
track  (for  standardization)  of  each  spiral  (Figure  13,  p  53).  The  first  sample 
location  was  randomly  located  within  the  first  10  m  (32.8  ft)  of  the  straight- 
line  tracking  portion  of  each  spiral.  Subsequent  samples  were  systematically 
located  approximately  every  5  m  along  the  vehicle  track  resulting  in  approx¬ 
imately  15  sample  points  per  spiral.  DW  was  measured  perpendicular  to  the 
vehicle  track  and  encompassed  the  area  where  soil  and/or  vegetation  were 
impacted  by  the  vehicle  tire/track.  The  DW  included  areas  where  vegetation 
was  flattened  (but  not  killed)  and  areas  where  soil  was  removed  or  piled  up. 
DW  was  recorded  at  each  sample  point.  Vegetation  cover  was  estimated  us¬ 
ing  a  line  transect  established  perpendicular  to  the  track  (same  measure¬ 
ment  line  as  the  DW  measurement). 

A  second  line  transect  was  established  perpendicular  to  the  track  and  ad¬ 
jacent  to  the  track.  Each  undisturbed  paired  transect  was  located  to  the 
outside  of  the  spiral  in  untracked  vegetation  and  is  of  the  same  width  as 
the  disturbed  transect.  For  each  line  transect  (within  track  and  adjacent  to 
the  track),  bare  ground  was  visually  estimated  and  reported  as  a  percent  of 
transect  length.  Vegetation  loss  is  the  difference  between  the  two  values. 
Vegetation  loss  was  measured  at  each  sample  point.  Rut  depth  was  meas¬ 
ured  using  a  ruler  laid  horizontally  across  the  outside  track  from  undis¬ 
turbed  soil  on  the  inside  of  the  track  to  undisturbed  soil  on  the  outside  of 
the  track.  A  second  ruler  measured  the  deepest  portion  of  the  rut.  Rut 
depth  was  measured  at  each  sample  point.  A  drop  cone  measurement  was 
taken  at  each  location  to  measure  surface  cone  index. 
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Sample  points  were  measured  as  paired  sample  locations  within  the  track 
and  outside  of  the  track.  Pre-disturbance  measurements  were  not  taken  due 
to  the  inability  to  accurately  predict  the  location  and  width  of  the  disturbed 
area.  Due  to  the  difficulty  of  trying  to  maintain  a  constant  velocity  and  de¬ 
creasing  turning  radius,  drivers  were  frequently  unable  to  follow  exactly 
pre-marked  courses.  This  sampling  approach  assumes  that  the  disturbed 
area  and  adjacent  undisturbed  area  have  the  same  pre-disturbance  cover. 

The  line  transect  used  to  measure  vegetation  cover  and  rut  depth  was  not  a 
fixed  length.  The  line  transect  was  the  width  of  the  disturbed  track  (DW). 
This  width  varied  across  the  course  usually  varying  from  the  width  of  a  track 
(or  tire)  in  straight  sections  to  several  track  (or  tire)  widths  in  sharp  turns. 

Site  characterization  data  were  collected  in  the  undisturbed  transect  loca¬ 
tion.  Soil  moisture  was  recorded  with  a  Time  Domain  Reflectometry 
(TDR)  soil  moisture  probe.  A  drop  cone  measurement  was  taken  at  each 
location  to  measure  surface  cone  index.  Additional  site  characterization 
data  were  collected  at  three  sample  points.  The  sample  points  were  3 
(straight),  8  (moderate  turn),  15  (sharp  turn).  Above  ground  biomass,  be¬ 
low  ground  biomass,  soil  texture,  bulk  density,  and  soil  moisture  (gravi¬ 
metric)  were  measured.  Above  ground  biomass  was  measured  by  clipping 
all  vegetation  above  ground  in  a  V4  m2  frame.  Biomass  was  oven-dried  and 
weighed.  Below  ground  biomass  was  collected  from  a  sample  obtained 
from  a  soil  core  for  the  top  10  cm.  Roots  were  removed  by  washing  and  ov¬ 
en-dried  and  weighed.  Soil  moisture  and  texture  were  obtained  from  a  soil 
core  for  the  top  10  cm.  Soil  moisture  was  the  percent  moisture  before  and 
after  oven  drying.  Texture  was  obtained  by  sieving  the  oven-dried  soil 
sample.  Torsional  shear  strength  was  measured  with  a  Cohran  torsional 
shear-graph.  Cone  index  was  measured  for  the  soil  profile  with  a  cone 
penetrometer.  These  data  were  used  to  supplement  the  drop  cone  meas¬ 
urements  take  at  each  sampling  point  (described  above)  that  more  accu¬ 
rately  measure  cone  index  near  the  soil  surface. 

5.5. 1.2  Model  validation  live  training  event  study 

Event  tracking  consisted  of  instrumenting  between  10  and  20  vehicles 
with  VDMTS  systems  and  tracking  a  live  training  event.  The  installation 
selected  the  live  training  events  with  the  intent  of  having  multiple  vehicle 
types  training  across  a  range  of  site  conditions  typical  of  the  installation. 
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Tracking  units  were  installed  on  vehicles  in  the  motor  pool.  Tracking  units 
were  removed  after  the  event  is  completed.  The  intent  was  to  monitor  a 
minimum  of  10  vehicles  for  sampling  purposes.  Additional  vehicles  were 
tracked  when  possible  in  case  of  hardware  failure,  vehicle  failure,  or  where 
training  doctrine  resulted  in  some  vehicles  with  little  off-road  travel. 

Field  study  preparation  included  downloading  VDMTS  data  into  a  GIS  da¬ 
ta  management  system.  Vehicle  paths  were  combined  with  an  installation 
GIS  roads  data  layer.  Off-road  vehicle  travel  was  identified.  The  resulting 
off- road  vehicle  paths  constitute  the  population  for  sampling.  For  off-road 
travel  areas,  vegetation  loss  (DW,  impact  severity,  and  cumulative  impact) 
and  rut  depth  were  estimated  using  the  VDMTS  models.  Vehicle  paths 
were  loaded  into  high-quality  GPS  units  for  use  in  field  data  collection. 

Primary  field  data  collection  consisted  of  using  high-quality  GPS  units  to 
follow  previously  driven  vehicle  paths.  Existing  vehicle  paths  were  driv¬ 
en/walked.  When  vehicle  paths  went  off-road,  samples  were  taken.  Sample 
locations  were  based  on  the  GPS  location  and  visual  location  of  the  vehicle 
track.  This  sampling  allowed  for  an  unbiased  comparison  of  actual  and 
predicted  vegetation  loss,  impact  severity,  and  rutting.  The  primary  sam¬ 
pling  was  representative  of  actual  training  and  site  conditions. 

Measurements  were  taken  at  each  sample  location.  GPS  location  was  ob¬ 
tained  from  high-quality  GPS  unit  of  the  sample  plot  location.  DW,  IS,  and 
rut  depth  were  measured  as  described  above.  Site  characterization  data 
were  also  collected  as  described  previously  in  Section  5. 5.1.1,  “Controlled 
event  study”  (p  58). 

Sample  points  were  measured  as  paired  sample  locations  within  the  track 
and  outside  of  the  track.  Pre-disturbance  measurements  were  not  taken 
due  to  the  inability  to  predict  the  location  of  the  disturbed  areas  before  the 
training  event.  This  sampling  approach  assumes  the  disturbed  area  and 
adjacent  undisturbed  area  have  the  same  pre-disturbance  cover. 

5.5. 1.3  Multiple  live  training  event  study 

A  subset  of  the  total  number  of  events  scheduled  for  the  installation  for  the 
year  was  sampled  at  each  location.  Specific  events  were  selected  that  ad¬ 
dress  the  management  issue  identified  for  the  installation.  A  subset  of  the 
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total  number  of  vehicles  in  an  event  was  evaluated  so  the  subset  of  vehicles 
was  representative  of  the  whole  training  event.  This  allowed  data  from  the 
subset  to  be  extrapolated  to  the  whole  event.  The  sampling  accounted  for 
differences  in  units  and  vehicle  types. 

For  each  training  event,  approximately  10-20  vehicles  were  instrumented 
and  tracked  depending  on  the  training  event  selected  and  the  number  of 
vehicles  in  each  event.  In  several  cases,  the  number  of  vehicles  in  the  train¬ 
ing  event  was  less  than  10  so  all  vehicles  were  tracked.  Selection  of  vehicles 
for  tracking  was  based  on  input  from  installation  military  and  natural  re¬ 
sources  personnel  as  described  in  the  previous  section.  Military  personnel 
provided  input  on  vehicle  use  as  related  to  doctrine.  Natural  resources 
personnel  helped  to  relate  vehicle  selection  to  the  decisionmaking  process. 

5.5.2  Calibration  of  equipment 

Individual  VDMTS  tracking  units  require  an  initial  calibration  process  to 
account  for  slight  differences  in  INS  system  sensors.  Each  unit  was  cali¬ 
brated  by  Cybernet  before  use  in  the  demonstration  project.  Calibration  is 
a  one-time  process  conducted  at  Cybernet  facilities  prior  to  delivery  of  the 
units.  After  purchase/delivery  of  the  VDMTS  hardware,  no  additional  cali¬ 
bration  is  needed. 

5.5.3  Quality  assurance  sampling 

The  VDMTS  system  relates  positional  accuracy  in  terms  of  HDOP  and  age  of 
differential  correction.  This  allowed  each  data  point  to  be  analyzed  for  posi¬ 
tional  accuracy  and  quality  assurance.  VDMTS  vehicle  dynamic  property 
data  collection  was  also  supplemented  with  high-cost,  high-quality  GPS  sys¬ 
tems  in  the  controlled  study  as  backup  systems  and  validation  dataset. 

5.5.4  Sampling  documentation 

Standardized  field  data  sheets  were  used  to  document  vehicle  ID,  type,  and 
mission,  and  the  VDMTS  unit  ID  mounted  on  each  vehicle.  All  field  data 
were  combined  from  all  three  collaborators  and  archived  at  each  location. 
VDMTS  tracking  data  were  stored  in  text  format,  shared  among  all  three 
collaborators,  and  archived  by  all  three  collaborators.  Standardized  training 
documentation  sheets  were  used  to  document  technician  training  times  and 
times  required  for  technicians  to  perform  each  step  of  VDMTS  process. 
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5.6  Sampling  results 

5.6.1  Hardware  tests 

The  first  component  of  the  controlled  field  study  demonstration  plan  was 
to  validate  the  hardware  is  properly  functioning  and  recording  vehicle  dy¬ 
namic  and  static  properties  for  use  in  subsequent  tests.  Tests  conducted 
included  location,  velocity,  turning  radius,  and  under  heavy  cover  (forcing 
INS  system  performance).  The  hardware  system  tests  were  conducted  at 
the  University  of  Tennessee.  Results  are  applicable  to  all  demonstration 
sites  (Fort  Riley,  Fort  Benning,  Eglin  AFB,  and  PTA). 

For  the  static  positional  test,  the  VDMTS  system  was  compared  against 
three  other  GPS  systems.  An  additional  INS/GPS  system  was  also  tested  to 
analyze  system  performance.  Average  distance  error  (m),  CEP,  the  2DRMS 
were  all  calculated  (Table  7).  The  VDMTS  system  was  the  worst  perform¬ 
ing  of  the  five  systems  tested.  This  was  because  the  GPS  signal  in  the  initial 
VDMTS  system  was  not  differentially  corrected.  The  other  units  tested  all 
used  differential  correction  to  increase  the  positional  accuracy.  A  GPS  sys¬ 
tem  capable  of  Wide  Area  Augmentation  System  (WAAS)  differential  cor¬ 
rection  replaced  the  previous  GPS  system  in  the  VDMTS.  The  static  posi¬ 
tion  evaluation  test  was  repeated.  Figure  14  shows  a  plot  of  the  VDMTS 
unit  longitudinal  and  latitudinal  error  (in  meters)  over  the  6-hr  test,  in 
which  the  origin  (0,0)  represents  the  true  location  of  the  tracking  systems. 
Table  8  lists  the  test  results  using  the  upgraded  VDMTS  system. 

A  velocity  evaluation  test  was  performed  on  the  VDMTS  system  as  de¬ 
scribed  in  Section  5.3.2  (p  50).  Table  9  lists  the  results  from  the  velocity 
evaluation  test.  The  truth  value  represents  the  actual  measured  velocity 
while  the  VDMTS  values  represent  the  VDMTS  calculated  velocity. 

Accuracy  of  turning  radius  was  measured  by  mounting  the  units  on  a  cart 
pushed  at  two  velocities  on  the  track  with  a  range  of  known  turning  radii 
as  described  in  Section  5.3.3  (p  51).  Figure  15  shows  of  graph  of  the  data 
collected  and  Table  10  summarizes  the  results. 

The  final  success  criteria  for  the  first  performance  objective  was  to  determine 
ability  to  record  in  situations  when  GPS  signals  were  not  available  due  to  to¬ 
pography,  vegetation,  and  related  conditions.  This  was  tested  by  driving  the 
unit  through  a  tunnel  and  under  canopy.  Results  show  that  the  INS  data  col¬ 
lected  from  the  Vehicle  Dynamics  Monitor  (VDM)  hardware  increase  the  ac¬ 
curacy  when  compared  to  systems  without  INS  capability  (Table  11). 
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Table  7.  Initial  position  evaluation  tests  (m). 


Metric 

VDMTS 

INS/GPS 

G18 

T132 

T332 

Average 

7.39 

4.25 

2.48 

1.72 

0.06 

CEP 

6.94 

2.58 

2.58 

1.14 

0.06 

2DRMS 

12.13 

3.90 

3.90 

4.55 

0.10 

Distance  Error  Chart 


Longitude  (meters) 

6  8 


-4 

Latitude 

(meters)  •  Upgraded  VDMTS 

-6  •  Trimble  132 

•  Garmin  18_18  ''N 

Garminl8  15 

-8  1 - = - 1 

Figure  14.  Positional  error  tests  with  upgraded  VDMTS  hardware. 


Table  8.  Upgraded  VDMTS  position  evaluation  tests  (m). 


Metric 

VDMTS 

(upgraded) 

VDMTS 

(initial) 

G18  (#1) 

G18  (#2) 

T132 

Avg.  error  (m) 

2.05 

7.39 

2.11 

2.75 

0.28 

CEP  (m) 

2.00 

6.94 

1.89 

3.04 

0.20 

2DRMS (m) 

3.71 

12.13 

3.74 

4.44 

0.64 

Avg.  HDOP 

0.9 

NA 

1.1 

1.0 

1.1 

Avg.  SAT  No. 

10.5 

NA 

8.3 

8.3 

7.7 

DGPS  %* 

100 

NA 

100 

100 

100 

*DGPS  =  Differential  Global  Positioning  System 

Upgraded  VDMTS 
Trimble  132 
Garmin  18_18 
Garmin  18_1S 
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Table  9.  Velocity  evaluations  (m/s). 


Test 

Truth  (m/s) 

VDMTS  (m/s) 

Error  (m/s) 

Error  % 

1 

1.43 

1.47 

-0.04 

3.00 

2 

1.62 

1.76 

-0.14 

8.64 

3 

1.40 

1.43 

-0.03 

2.19 

Average 

1.48 

1.55 

-0.07 

4.80 

u> 

c 

IE 

£ 

o 


Easting 

•  GPS  B  *  T  332  •  T  132  *G  18  ■  GPS  A 


Figure  15.  Turning  radius  evaluation  tests  (m). 


Table  10.  Turning  radius  evaluation  tests  (m). 


Velocity 

Actual  TR 

VDMTS 

INS/GPS 

G18 

T132 

T332 

Slow 

6.7 

6.5 

4.0 

4.0 

Slow 

10.5 

10.8 

6.7 

6.1 

Slow 

18.6 

20.0 

10.9 

14.1 

Slow 

38.0 

62.3 

54.0 

53.8 

62.0 

49.7 

Slow 

48.0 

48.4 

59.0 

47.2 

65.8 

72.3 

Fast 

38.0 

49.4 

39.8 

48.8 

38.9 

39.3 

Fast 

48.0 

58.5 

46.1 

55.3 

50.2 

54.4 

Table  11.  Positional  error  under  heavy  cover  test. 


GPS  System 

Average  Distance  Error  (m) 

Standard  Deviation  (m) 

Trimble  (without  INS) 

2.7 

0.25 

Garmin  (without  INS) 

2.7 

0.34 

VDM 

2.2 

0.17 
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5.6.2  Controlled  test  model  validation 

The  main  objective  of  the  controlled  test  as  to  validate  that  the  impact 
models  accurately  predicted  site  impacts  based  on  vehicle  dynamic  prop¬ 
erties.  Tests  conducted  included  DW,  vegetation  loss,  and  rut  depth  meas¬ 
urements.  These  tests  were  performed  using  multiple  vehicles  at  Fort  Ri¬ 
ley,  PTA,  and  Eglin  AFB.  The  theoretical  model  results  were  compared 
with  measured  impact  values.  Additionally,  measured  impact  values  were 
used  to  develop  site-,  vehicle-,  and  condition-specific  statistical  models 
(Figure  16  and  Table  12).  These  statistical  models  represent  the  best  pre¬ 
diction  possible  with  the  variability  observed  and  are  a  current  method  of 
impact  assessment. 

A  linear  regression  of  the  predicted  vs.  measured  data  was  performed  to  de¬ 
termine  the  closeness  to  a  unity  slope.  Using  this  as  an  indicator  of  model 
quality,  the  DW  statistical  model  performed  slightly  better  than  the  theoret¬ 
ical  model  at  Eglin  AFB  and  PTA,  but  not  at  Fort  Riley  (Figures  17-19). 

Using  linear  regression  as  an  indicator  of  model  success,  the  statistical  IS 
(vegetation  removal)  models  slightly  outperformed  the  theoretical  models 
for  the  controlled  studies  (Figures  20-22).  Given  the  intended  use  of  the 
models,  a  more  appropriate  measure  of  model  validation  is  the  average  er¬ 
ror  between  the  predicted  and  measured  impacts  using  each  model  (Table 
13).  Since  the  models  are  intended  to  quantify  impacts  over  an  entire 
training  event,  the  errors  were  calculated  over  the  entire  controlled  study 
at  each  location. 

The  statistical  models  predicted  DW  and  IS  better  than  the  theoretical 
models  in  five  of  the  six  instances  (Figures  17-22).  This  observation  is  ex¬ 
pected  since  the  measured  data  were  actually  used  to  develop  the  statisti¬ 
cal  models  in  this  case.  A  separate  dataset  would  need  to  be  collected  to 
assess  unbiased  statistical  model  performance  under  the  controlled  study. 


ERDC/CERL  TR-12-11 


66 


Turning  Radius  (m) 

Figure  16.  Example  of  statistical  regression  model 
developed  for  Stryker  vehicle  at  PTA. 


Table  12.  Statistical  regression  models  developed 
during  controlled  study. 


Site 

Vehicle 

Regression 

Fort  Riley 

M1A1 

DW  =  295.36(TR)'0188 

Fort  Riley 

M1A1 

IS  =  241.92(TR)°-349 

Fort  Riley 

APC-M113 

DW  =  126.54(TR)'°-208 

Fort  Riley 

APC-M113 

IS  =  210.12(TR)°-445 

Fort  Riley 

HMMWV 

DW  =  172.94(TR)  °-262 

Fort  Riley 

HMMWV 

IS  =  17.85(TR)-°096 

Fort  Riley 

HEMTT 

DW  =  792.94(TR)°-47 

Fort  Riley 

HEMTT 

IS  =  210.12(TR)°-445 

Eglin  AFB 

M2A2 

DW  =  372.78(TR)  °-271 

Eglin  AFB 

M2A2 

IS  =  378.53(TR)-°-571 

Eglin  AFB 

HEMTT 

DW  =  1373.5(TR)-°-571 

Eglin  AFB 

HEMTT 

IS  =  10.74(TR)‘0013 

PTA 

Stryker 

DW  =  272.35(TR)  °-335 

PTA 

Stryker 

IS  =  108.71(TR)-°-456 
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Figure  17.  Theoretical  and  statistical  model  predicted  DW  values 
compared  with  measured  values  for  Fort  Riley  controlled  study. 


Figure  18.  Theoretical  and  statistical  model  predicted  DW  values 
compared  with  measured  values  for  Eglin  AFB  controlled  study. 


Figure  19.  Theoretical  and  statistical  model  predicted  DW  values 
compared  with  measured  values  for  PTA  controlled  study. 
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Table  13.  Average  absolute  error  between  predicted  and  measured  values  for  theoretical  and 

statistical  models. 


Error 

Riley 

Eglin  AFB 

PTA 

DW* 

IS* 

RD 

DW 

IS 

RD 

DW 

IS 

RD 

Theoretical 

Average  Absolute  Error 

22.0 

9.8 

1.1 

33.9 

9.8 

0.1 

22.4 

13.4 

0.7 

Average  Error 

-7.7 

-3.7 

1.0 

17.4 

-8.2 

-0.1 

-16.2 

11.9 

0.6 

Statistical 

Average  Absolute  Error 

13.0 

11.5 

3.9 

24.2 

7.5 

0.9 

14.8 

10.8 

1.0 

Average  Error 

1.5 

1.9 

-3.9 

-0.8 

0.5 

-0.9 

2.3 

3.3 

0.1 

*  Units  are  cm  for  DW  rut  depth  [RD]  and  percentage  for  impact  severity  [IS]. 


Figure  20.  Theoretical  and  statistical  model  predicted  IS  values  compared 
with  measured  values  for  Fort  Riley  controlled  study. 


Figure  21.  Theoretical  and  statistical  model  predicted  IS  values  compared 
with  measured  values  for  Eglin  AFB  controlled  study. 
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Figure  22.  Theoretical  and  statistical  model  predicted  IS  values  compared 
with  measured  values  for  PTA  controlled  study. 

5.6.3  Single  live  training  event  study  and  model  validation 

VDMTS  hardware  and  models  were  tested  in  live  training  events  by  track¬ 
ing  a  live  training  event  at  Fort  Riley  and  Fort  Benning.  VDMTS  data  were 
used  to  locate  vehicle  tracks  following  the  training  event.  Measured  im¬ 
pacts  from  these  tracks  were  compared  with  model  predicted  values.  The 
statistical  models  developed  at  both  sites  were  also  used  to  predict  im¬ 
pacts.  The  theoretical  predicted  values  were  compared  against  the  impacts 
measured  in  the  field  as  well  as  the  statistical  model  predicted  values  (Fig¬ 
ures  23-26). 


Figure  23.  Theoretical  and  statistical  model  predicted  DW  values  compared  with  measured 
values  for  Fort  Riley  live  training  event  study. 
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Figure  24.  Theoretical  and  statistical  model  predicted  DW  values  compared  with  measured 
values  for  Fort  Benning  live  training  event  study. 


Measured  IS  (%) 


Figure  25.  Theoretical  and  statistical  model  predicted  IS  values  (vegetation  removal) 
compared  with  measured  values  for  Fort  Riley  live  training  event  study. 


Figure  26.  Theoretical  and  statistical  model  predicted  IS  values  (vegetation  removal) 
compared  with  measured  values  for  Fort  Benning  live  training  event  study. 
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The  agreement  between  predicted  and  measured  values  is  generally  lower 
for  the  live  training  events  compared  with  the  controlled  events  when 
looking  at  the  slope  of  the  linear  regression  model  (Figures  23-26  vs.  Fig¬ 
ures  17-22).  These  measurements  were  taken  across  the  landscape  with 
varying  terrain  and  vegetation  giving  more  variability  than  in  the  relatively 
flat,  homogeneous  vegetation  cover  observed  in  the  controlled  studies.  The 
theoretical  models  could  likely  be  improved  by  incorporating  a  slope  or 
terrain  factor.  However,  this  would  also  make  model  use  more  data  inten¬ 
sive  and  increase  implementation  costs. 

Even  though  the  regression  between  predicted  and  measured  was  not  as 
good  for  the  live  event  study,  the  average  absolute  errors  for  the  theoretical 
models  in  the  live  training  event  study  are  comparable  to  the  errors  meas¬ 
ured  in  the  controlled  study  (Table  14).  The  controlled  studies  were  de¬ 
signed  to  provide  a  large  range  of  velocities  and  turning  radii  to  stress  the 
models.  However,  from  the  two  live  training  events,  it  appears  that  most  of 
the  off-road  training  occurred  in  a  smaller  range  of  turning  radii  and  at  ve¬ 
locities  that  resulted  in  a  smaller  range  of  DW  and  IS,  which  explains  why 
the  average  absolute  errors  remained  similar  despite  the  poorer  regression. 

While  the  statistical  models  performed  better  than  the  theoretical  models 
in  the  controlled  study,  the  theoretical  models  performed  as  well  as  statis¬ 
tical  models  in  the  live  single  training  event  study.  In  practice,  this  means 
that  the  theoretical  models  may  perform  as  well  as  site-specific  statistical 
models  in  estimating  impacts  from  a  military  training  event.  Before  using 
this  methodology,  a  separate  study  would  have  been  required  to  develop 
an  empirical  model  for  each  site  being  tested  resulting  in  added  study 
costs.  The  theoretical  model  removes  this  necessity  while  providing  an  es¬ 
timate  of  the  training  event  impacts. 

Table  14.  Absolute  average  errors  between  predicted  and  measured  impacts  for  live  training  events. 


Fort  Riley 

Fort  Benning 

Combined 

DW 

IS 

RD 

DW 

IS 

RD 

DW 

IS 

RD 

Theoretical 

24.8 

7.7 

0.7 

34.8 

4.9 

0.0 

29.7 

6.3 

0.4 

Statistical 

27.2 

12.9 

0.9 

32.6 

6.4 

0.5 

29.7 

8.3 

0.7 
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In  addition  to  modeling  performance,  hardware  durability  and  positional 
accuracy  were  assessed  in  the  single  live  training  event  tests.  Table  15 
summarizes  the  total  training  time,  recorded  time,  and  percent  of  total 
training  time  for  each  training  event. 

The  positional  accuracy  was  calculated  by  comparing  the  location  of  the 
tracks  in  the  field  with  the  VDMTS  collected  data  at  Fort  Riley  and  Fort 
Benning.  At  Fort  Riley,  the  observed  positional  accuracy  was  1.6  m 
(±  0.1  m).  At  Fort  Benning,  the  observed  positional  accuracy  was  1.1  m 
(±  0.1  m).  At  several  instances  during  the  live  training  event  at  Fort  Riley, 
the  GPS  signal  was  lost.  In  these  cases,  the  VDMTS  INS  system  succeeded 
in  calculating  vehicle  location.  Figure  27  shows  one  instance  where  the 
GPS  lost  reception  and  INS  calculated  the  vehicle  location.  In  this  in¬ 
stance,  the  GPS  signal  was  lost  for  over  700  m.  The  blue  line  indicates  the 
INS  vehicle  location  while  the  red  line  shows  GPS  predicted  points.  The 
GPS  system  assumed  the  vehicle  path  was  a  straight  line  during  the  GPS 
signal  loss. 

To  quantitatively  assess  INS  performance  without  GPS  signal,  data  were 
analyzed  with  and  without  INS  data  being  forced  to  the  GPS  signal.  This 
allowed  a  measurement  of  INS  data  error  compared  with  the  GPS  signal.  A 
subset  of  10  out  of  the  38  single  live  training  event  vehicle  files  (48259 
sampling  points)  was  analyzed  for  INS  performance.  In  the  subset  of  10 
vehicles,  the  positional  accuracy  never  exceeded  the  10  m  threshold  signi¬ 
fying  the  success  criterion  was  met.  The  average  error  compared  with  the 
GPS  signal  was  0.i64±0.002  m.  Across  the  48,259  samples,  the  maximum 
error  compared  with  the  GPS  signal  was  2.60  m. 


Table  15.  Summary  of  hardware  durability  (training  time  recorded)  from 
single  live  training  events. 


Installation 

Total  Time  (hrs) 

Recorded  Time  (hrs) 

%  Recorded 

Fort  Riley 

1800.0 

1489.1 

82.7 

Fort  Benning 

209.6 

209.7 

100.0 

PTA 

628.0 

556.0 

88.5 

TOTAL 

2637.6 

2254.8 

85.5 
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Figure  27.  INS  vehicle  location  during  GPS  signal  loss. 


5.6.4  Multiple  live  training  event  tests 

As  described  in  Section  5.4.3  (p  54),  a  field  study  comprised  tracking  mul¬ 
tiple  training  events  (Table  6,  p  55)  was  performed  for  system  validation. 
The  main  objective  of  this  phase  of  the  demonstration  was  to  test  and  vali¬ 
date  the  usability  of  the  system  (hardware,  models,  and  results)  and 
demonstrate  the  ability  for  the  results  to  aid  in  military  land-use 
decisionmaking.  In  addition  to  the  actual  vehicle-tracking  and  impact  data 
from  the  training  events,  data  were  collected  to  assess  hardware  durability 
and  ease  of  system  use. 

5.6.4. 1  Multiple  live  training  event  hardware  durability 

Hardware  durability  was  assessed  through  measuring  the  percent  of  each 
training  event  that  was  recorded  by  the  vehicular  tracking  systems.  Any 
loss  of  data  was  attributed  to  hardware  error  (e.g.,  hardware  breakage, 
power  failure,  data  card  fault,  loss  of  hardware).  Table  16  summarizes  the 
total  time  recorded  and  total  training  time  recorded  for  each  event. 
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Table  16.  Hardware  durability  performance  by  event  (percentage  of  training  time  recorded). 


Installation 

Date 

#  Vehicles 

Total  Time  (hr) 

Recorded  Time  (hr) 

%  Recorded 

Fort  Riley 

17-21  Aug  2009 

18 

1800.0 

1489.1 

82.7 

Fort  Riley 

13-15  Jul  2010 

7 

332.6 

250.9 

77.8 

Fort  Riley 

10-17-May2011 

12 

2108.2 

1682.6 

79.8 

Fort  Riley 

17-22  May  2011 

11 

1515.9 

1225.6 

80.8 

Fort  Benning 

18-20  Oct  2010 

9 

519.5 

519.2 

99.9 

Fort  Benning 

28-29  Mar  2011 

7 

209.6 

209.7 

100.0 

Fort  Benning 

31  Oct  -  9  Nov  2011 

20 

4215.2 

3998.6 

94.9 

Fort  Benning 

9-14  Nov  2011 

22 

2700.3 

2700.3 

100 

PTA 

6-9  Nov  2009 

3 

86.9 

86.9 

100 

PTA 

24-29  Jan  2010 

6 

509.9 

471.8 

92.5 

PTA 

17-23  Jan  2011 

6 

628.0 

556.0 

88.5 

PTA 

8-10 Jun  2011 

2 

49.2 

49.2 

100.0 

PTA 

13-14  Jun  2011 

6 

171.3 

143.6 

83.8 

PTA 

16-17  Jun  2011 

7 

220.2 

2 

92.5 

TOTAL 

139 

15056.8 

13587.1 

90.2±2.3 

A  total  of  13,587.1  hours  of  data  were  recorded  out  of  15,056.8  hours  of  to¬ 
tal  training  time  during  which  the  units  were  mounted  (90.2±2.5%).  In 
addition,  recorded  time  was  analyzed  by  vehicle  type  to  determine  if  hard¬ 
ware  durability  is  a  function  of  vehicle  type  (Table  17).  Except  for  the 
HEMTT,  over  80%  of  the  data  were  recorded  for  each  vehicle.  Section  6.6 
(p  82)  contains  a  discussion  on  causes  for  greater  hardware  failure  rates 
for  the  HEMTT  vehicle. 

5.6.4. 1  Multiple  live  training  event  ease  of  use 

A  second  objective  of  the  multiple  live  training  event  demonstration  phase 
was  to  assess  the  time  requirements  for  implementing  the  VDMTS  process. 
As  described  in  Section  5.4.3  (p  54),  the  time  required  for  training  techni¬ 
cians  on  each  step  of  the  VDMTS  as  well  as  time  required  to  perform  each 
step  were  recorded.  Table  18  documents  the  number  of  technicians  trained 
for  each  step  and  the  training  time  required  for  each  step.  Table  19  exhibits 
the  time  required  to  perform  each  step  of  the  VDMTS  process  and  summa¬ 
rizes  the  number  of  vehicles  and  events  for  which  these  data  were  collected. 
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Table  17.  Hardware  durability  performance  by  vehicle  type  (percentage  of  training 

time  recorded). 


Vehicle 

Type 

Number  Vehicles 

Total  Time  (hr) 

Recorded  Time  (hr) 

%  Recorded 

HMMWV 

Wheeled 

59 

8085.6 

7597.9 

93.9±2.9 

MTV 

Wheeled 

7 

649.4 

550.5 

84.8+11.3 

Buffalo 

Wheeled 

1 

71.9 

71.9 

100.0±0.0 

Stryker 

Wheeled 

18 

1785.2 

1785.2 

99.98±0.0 

Bradley 

Tracked 

6 

289.7 

289.7 

100.0±0.0 

AAV 

Tracked 

26 

1578.6 

1424.2 

90.2±4.6 

Abrams 

Tracked 

1 

30.1 

30.1 

100±0.0 

HEMTT 

Wheeled 

12 

1881.4 

1181.2 

62.79±13.9 

LMTV 

Wheeled 

4 

626.4 

626.4 

100.0±0.0 

Table  18.  Training  times  for  each  step  of  VDMTS  implementation  for 


ease  of  use  assessment. 


Ease  of  Use  -  Training  Times 

Parameter 

Hardware  Use 

Data  QA/QC 

Analysis 

#  Technicians  Trained 

16 

6 

6 

Average  Time  (hr) 

0.3 

1.07 

6.33 

Standard  Deviation  (hr) 

0.12 

0.11 

0.82 

Standard  Error  (hr) 

0.23 

0.35 

2.58 

Table  19.  Performance  times  for  each  step  of  VDMTS  implementation 


for  ease  of  use  assessment. 


Ease  of  Use  -  Performance  Times 

Parameter 

Equipment 

Setup/Removal 

(hr/vehicle) 

Data  QA/QC 
(hr/vehicle  file) 

Analysis 

(hr/event) 

#  Vehicles 

136 

136 

136 

#  Events 

14 

14 

14 

Average  Time  (hr) 

0.19 

0.82 

5.45 

Standard  Deviation  (hr) 

0.11 

0.24 

3.57 

Standard  Error  (hr) 

0.01 

0.02 

0.95 
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6  Performance  Assessment 

6.1  Controlled  field  study— Accurate  VDMTS  hardware  measurement 

The  first  component  of  the  controlled  field  study  demonstration  plan  was 
to  validate  the  hardware  function  for  recording  vehicle  dynamic  and  static 
properties  for  use  in  subsequent  tests.  Tests  conducted  included  location, 
velocity,  turning  radius,  and  GPS  signal  loss  (forcing  INS  system  perfor¬ 
mance).  The  hardware  system  tests  were  conducted  at  the  University  of 
Tennessee.  Results  are  applicable  to  all  demonstration  sites  (Fort  Riley, 
Fort  Benning,  Eglin  AFB,  and  PTA). 

The  success  criteria  assigned  to  the  position  evaluation  test  was  vehicle 
positional  accuracy  within  5.0  m  (15.4  ft)  95%  of  the  time.  In  the  initial 
test,  the  VDMTS  system  was  the  worst  performing  of  the  five  systems  test¬ 
ed.  However,  after  upgrading  the  VDMTS  units  to  a  differentially  corrected 
GPS  sensor,  the  system  met  the  success  criteria.  The  6-hour  static  posi¬ 
tional  test  for  the  upgraded  unit  resulted  in  an  average  error  of  2.05  m 
with  99.87%  of  the  data  points  within  5.0  m  of  the  actual  location  exceed¬ 
ing  the  success  criteria  established. 

A  velocity  evaluation  test  was  performed  on  the  VDMTS  system.  The  suc¬ 
cess  criteria  assigned  to  this  test  was  vehicle  velocity  within  2.24  m/s  (5 
mph)  95%  of  the  time.  The  VDMTS  calculated  velocity  was  compared  to 
the  actual  velocity.  Three  tests  were  performed  and  the  VDMTS  was  well 
within  the  criteria  at  all  times.  The  velocity  evaluation  resulted  in  a  veloci¬ 
ty  within  2.24  m/s  (5  mph)  of  the  true  value  for  too  %  of  the  data  points. 

The  success  criteria  for  the  turning  radius  evaluation  test  was  turning  ra¬ 
dius  within  10  m  95%  of  the  time.  This  criterion  was  measured  by  mount¬ 
ing  the  units  on  a  cart  pushed  at  two  velocities  on  the  track  with  a  range  of 
known  turning  radii.  (Table  6  (p  55)  lists  the  results.  While  the  VDMTS  did 
not  predict  the  turning  radius  within  10  m  for  95%  of  the  time  at  both  ve¬ 
locities,  it  was  within  10  m  for  95%  of  the  test  with  the  high  accuracy,  high- 
cost  system  (the  best  prediction  available).  It  is  interesting  to  note  that  the 
unit  was  more  accurate  at  predicting  small  lower  turning  radii  (sharper 
turns).  Since  vehicle  impacts  increase  with  decreasing  turning  radii,  the 
VDMTS  unit  should  allow  for  accurate  impact  prediction.  Even  though 
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turning  radius  prediction  errors  increased  with  increasing  turning  radii, 
the  associated  impact  prediction  error  is  small  since  lower  impacts  are  ob¬ 
served  in  these  conditions.  Although  the  VDMTS  hardware  did  not  explic¬ 
itly  meet  the  success  criteria  established,  it  performed  as  well  as  alterna¬ 
tive  high  accuracy  systems  indicating  metric  success. 

The  final  success  criteria  for  the  first  performance  objective  was  to  determine 
the  ability  to  record  in  situations  when  GPS  signals  were  not  available  due  to 
topography,  vegetation,  and  related  conditions.  This  was  tested  by  driving  the 
unit  through  a  tunnel  and  under  heavy  vegetation  cover.  Results  show  that 
the  INS  data  collected  from  the  VDM  hardware  increased  the  accuracy  when 
compared  to  systems  without  INS  capability.  This  is  also  illustrated  when  a 
GPS  signal  was  not  obtained  in  a  field  test  at  Fort  Riley  (Figure  27,  p  73).  The 
VDMTS  met  performance  Metric  1.1,  “VDMTS  hardware  with  INS  provides 
more  accurate  dynamic  vehicle  properties  than  GPS  alone.” 

6.2  Controlled  field  study— Accurate  VDMTS  impact  model 
predictions 

The  controlled  field  study  demonstration  plan  assessed  the  impact  models’ 
accuracy  of  predicting  site  impacts  based  on  vehicle  dynamic  properties. 
Tests  conducted  included  DW,  vegetation  loss,  and  RD  measurements. 
Impact  models  were  validated  under  controlled  conditions  and  during  live 
training  events  at  Fort  Riley,  Eglin  AFB,  and  PTA. 

The  success  criteria  assigned  to  the  model  validation  phase  of  the  demon¬ 
stration  for  DW  is  a  correlation  between  predicted  and  measured  values  of 
0.8  or  higher  and  95%  of  the  predicted  values  are  within  20  cm  of  the  ac¬ 
tual  value.  For  vegetation  loss  (IS),  the  success  criteria  were  a  correlation 
between  predicted  and  measured  values  of  0.7  or  higher  and  at  least  95% 
of  the  values  within  20%  vegetation  removal  accuracy.  The  criteria  set  for 
RD  accuracy  were  a  correlation  greater  than  0.6  and  95%  of  the  points 
within  3.0  cm  of  the  observed  rut  depths. 

Table  20  summarizes  the  results  from  the  controlled  study  at  each  loca¬ 
tion.  The  success  metric  was  generally  met  for  correlation  between  pre¬ 
dicted  and  measured  values  for  DW  and  vegetation  loss.  For  DW,  only 
50%  of  the  samples  were  within  the  20  cm  threshold.  The  theoretical  vege¬ 
tation  loss  (IS)  model  met  the  success  criteria  established.  While  the  RD 
model  met  the  percent  samples  within  defined  metric,  it  did  not  meet  the 
correlation  between  predicted  and  measured  metric. 
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When  analyzing  the  data,  it  became  apparent  that  the  amount  of  variabil¬ 
ity  experienced  in  measuring  impacts  was  underestimated  when  establish¬ 
ing  the  metrics.  In  a  validation  project,  metrics  are  established  to  compare 
results  against  some  value  to  determine  success  or  failure.  In  this  case, 
somewhat  arbitrary  metrics  had  been  established  based  on  some  previous 
data  collected.  Perhaps  a  better  estimation  of  the  theoretical  model  validity 
is  comparing  against  an  existing  method  of  predicting  impacts.  Prior  to  the 
development  of  the  theoretical  models,  a  statistical  regression  model  could 
be  developed  for  a  specific  site/vehicle  combination  based  on  a  field  study 
similar  to  the  controlled  study.  This  empirical  model  could  be  considered 
the  best  prediction  of  impacts  given  the  variability  experienced  in  the  field. 

As  a  secondary  measure  of  theoretical  model  success,  statistical  regression 
models  were  developed  for  each  site/vehicle  combination.  Results  from 
these  models  were  compared  with  the  same  success  criteria  established  for 
the  theoretical  models.  (Table  20  also  documents  the  results.)  It  is  im¬ 
portant  to  note  that  these  results  is  biased  towards  the  statistical  models 
since  they  were  developed  using  the  same  dataset  used  for  the  metric  eval¬ 
uation.  The  statistical  DW  model  slightly  outperforms  the  theoretical 
model;  however  it  is  not  close  to  meeting  the  metrics  established  (Table 
20).  In  fact,  the  theoretical  model  actually  outperforms  the  statistical 
model  in  nearly  every  measure.  For  RD,  it  is  apparent  that  the  Fort  Riley 
study  did  not  result  in  a  large  range  of  rut  depths.  While  the  model  predic¬ 
tions  were  very  close  to  the  observed  measurements,  the  correlation  be¬ 
tween  these  two  values  was  very  low. 

The  data  in  Tables  20  and  21  indicate  that  the  theoretical  model  perfor¬ 
mance  was  very  comparable  to  the  statistical  models.  When  taking  into  ac¬ 
count  that  this  is  biased  towards  the  statistical  model  and  the  theoretical 
models  can  be  used  across  different  locations  and  vehicles,  the  value  of  the 
theoretical  model  is  apparent.  For  this  comparison,  a  separate  statistical 
model  was  developed  for  each  site/vehicle  combination.  In  previous  im¬ 
pact  assessment  work,  this  was  required.  However,  a  single  theoretical 
model  can  be  used  across  different  locations  and  obtain  results  compara¬ 
ble  to  the  multiple  statistical  models. 
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Table  20.  Metric  Analysis  summary  for  theoretical  and  statistical  models  in  Fort  Riley,  Eglin 
AFB,  and  PTA  Controlled  Study  (Note:  Units  are  cm  for  DW,  RD  and  percentage  for  IS). 


DW 

IS 

RD 

Theoretical 

Stat_Mod 

Theoretical 

Stat_Mod 

Theoretical 

Stat_Mod 

Correlation  between 
predicted  and  measured 

0.89 

0.94 

0.90 

0.90 

0.1 

0.5 

Average  error  between 
predicted  and  measured 

-0.2  cm 

2.7  cm 

-1.3% 

1.7% 

0.5  cm 

-1.4  cm 

Average  absolute  error 
between  predicted  and 
measured 

28.0  cm 

18.8  cm 

10.8% 

9.7% 

0.6  cm 

1.8  cm 

%  Samples  within  de¬ 
fined  metric 

50% 

67% 

86% 

78% 

94% 

85% 

Table  21.  Average  absolute  error  between  predicted  and  measured  values  for  theoretical  and 
statistical  models  from  controlled  study  (Note:  Units  are  cm  for  DW,  RD  and  percentage  for 

IS). 


Riley 

Eglin  AFB 

PTA 

Combined 

DW 

IS 

RD 

DW 

IS 

RD 

DW 

IS 

RD 

DW 

IS 

RD 

Theoretical 

22.0 

9.8 

1.1 

33.9 

9.8 

0.1 

22.4 

13.4 

0.7 

28.0 

10.8 

0.6 

Statistical 

13.0 

11.5 

3.9 

24.2 

7.5 

0.9 

14.8 

10.8 

1.0 

18.8 

9.7 

1.8 

Table  8  (p  63)  lists  the  results  from  the  controlled  study  model  validation 
at  Fort  Riley.  The  theoretical  model  predictions  met  some  of  the  prede¬ 
fined  success  criteria  while  not  meeting  others.  However,  essentially  the 
same  outcome  was  observed  for  the  statistical  models.  When  creating  the 
metrics  and  success  criteria,  the  variability  of  experience  in  the  field  was 
underestimated.  This  is  evidenced  by  the  fact  that  the  site-specific  statisti¬ 
cal  models  did  not  even  meet  the  success  criteria.  In  summary,  even 
though  the  theoretical  models  did  not  meet  the  success  criteria  estab¬ 
lished,  their  validity  was  confirmed  since  they  produced  similar  results  to 
the  statistical  models.  While  theoretical  models  did  not  meet  all  of  the 
metrics  established,  their  performance  was  validated  when  compared  with 
previous  method  results. 

6.3  Single  live  training  event— Accurate  VDMTS  hardware 
measurements 

Single  live  training  events  were  tracked  at  Fort  Riley  and  Fort  Benning.  A 
total  of  38  vehicles  were  tracked  across  those  two  events  representing  four 
vehicle  types.  The  positional  accuracy  met  the  metric  criteria  with  an  off¬ 
road  positional  accuracy  observed  ofi.6m(±o.im). 
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At  several  instances  during  the  live  training  event  at  Fort  Riley,  the  GPS 
signal  was  lost.  In  these  cases,  the  VDMTS  INS  system  succeeded  in  calcu¬ 
lating  vehicle  location.  Figure  27  (p  73)  shows  one  instance  where  the  GPS 
lost  reception  and  INS  calculated  the  vehicle  location.  In  this  instance,  the 
GPS  signal  was  lost  for  over  700  m  (2296  ft). 

To  assess  INS  performance,  data  were  analyzed  on  a  subset  of  the  vehicle 
files  with  and  without  the  GPS  data  (48259  samples).  The  success  criteria 
for  this  metric  was  vehicle  positional  accuracy  within  10  m  (32.8  ft)  for 
300  m  (984.2  ft)  after  GPS  signal  was  lost  90%  of  time.  In  the  subset  of  10 
vehicles,  the  positional  accuracy  never  exceeded  the  10  m  threshold  signi¬ 
fying  the  success  criteria  were  met.  The  average  error  compared  with  the 
GPS  signal  was  0.i64±0.002  m.  Across  the  48259  samples,  the  maximum 
error  compared  with  the  GPS  signal  was  2.60  m. 

6.4  Single  live  training  event— Accurate  VDMTS  impact  model 

predictions 

One  component  of  the  single  live  training  event  study  at  Fort  Riley  and 
Fort  Benning  was  to  test  the  predictions  of  the  theoretical  impact  models 
in  field  conditions.  This  study  compared  model  predicted  impacts  with 
measured  impacts  from  the  same  event.  The  success  criteria  established 
for  this  test  was  predicted  DW  within  20  cm  of  actual  disturbed  width  in 
90%  of  the  sample  sites,  predicted  vegetation  loss  within  20%  of  actual 
vegetation  loss  in  80%  of  the  sample  sites,  and  predicted  RD  within  4  cm 
of  actual  rut  depth  in  80%  of  the  sample  sites.  As  discussed  in  Section 
5.6.3  (p  69),  the  predictions  from  the  statistical  regression  models  were 
also  compared  against  the  success  metrics  to  estimate  the  accuracy  of  the 
theoretical  models  compared  to  the  previous  method  of  predicting  im¬ 
pacts.  Tables  22-24  summarize  the  data  against  these  metrics. 


Table  22.  Summary  of  single  live  training  event  tracking  at  Fort  Riley. 


DW 

IS 

RD 

Theoretical 

Stat_Mod 

Theoretical 

Stat_Mod 

Theoretical 

Stat_Mod 

Average  error  between 
predicted  and  measured 

2.9  cm 

-21.4  cm 

-3.3% 

-12.3% 

0.1  cm 

-0.2  cm 

Average  absolute  error 
between  predicted  and 
measured 

24.8  cm 

27.2  cm 

7.7% 

12.9% 

0.7  cm 

0.9  cm 

%  Samples  within  defined 
metric 

48.8% 

52.4% 

93.9% 

82.9% 

98% 

100% 
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Table  23.  Summary  of  single  live  training  event  tracking  at  Fort  Benning,  GA. 


DW 

IS 

RD 

Theoretical 

Stat_Mod 

Theoretical 

Stat_Mod 

Theoretical 

Stat_Mod 

Average  error  between 
predicted  and  measured 

27.6  cm 

9.8  cm 

-0.2% 

5.9% 

0.0  cm 

-0.5  cm 

Average  absolute  error 
between  predicted  and 
measured 

34.8  cm 

32.6  cm 

4.9% 

6.4% 

0.0  cm 

0.5  cm 

%  Samples  within  de¬ 
fined  metric 

42.3% 

47.4% 

96.2% 

98.7% 

100% 

100% 

Table  24.  Summary  of  single  live  training  event  tracking  at  Fort  Riley,  KS  and  Fort  Benning, 

GA  (combined). 


DW 

IS 

RD 

Theoretical 

Stat_Mod 

Theoretical 

Stat_Mod 

Theoretical 

Stat_Mod 

Average  error  between  pre¬ 
dicted  and  measured 

14.9  cm 

-6.1  cm 

-1.8% 

-1.7% 

0.1  cm 

-0.2  cm 

Average  absolute  error  be¬ 
tween  predicted  and  meas¬ 
ured 

29.7  cm 

29.8  cm 

6.3% 

8.3% 

0.7  cm 

0.9  cm 

%  Samples  within  defined 
metric 

45.6% 

50.6% 

95.0% 

93.1% 

98% 

100% 

The  metrics  established  for  vegetation  loss  and  RD  were  met  (vegetation 
loss  within  20%  and  rut  depth  within  4  cm  of  the  actual  values  for  at  least 
80%  of  the  sampling  sites)  while  the  metric  established  for  DW  did  not 
meet  the  established  metric  (<  90%  of  the  data  within  20  cm  of  actual  dis¬ 
turbed  width).  However,  the  average  absolute  error  between  the  predicted 
and  measured  values  for  DW  was  the  same  when  predicted  with  the  theo¬ 
retical  model  and  the  site  and  vehicle-specific  statistical  model  (29.7  cm 
vs.  29.8  cm).  While  the  statistical  models  performed  better  than  the  theo¬ 
retical  models  in  the  controlled  study,  the  theoretical  models  performance 
was  similar  to  the  statistical  models  in  the  live  single  training  event  study. 
In  fact,  the  theoretical  model  performed  better  than  the  site  and  vehicle- 
specific  statistical  model  in  predicting  vegetation  loss.  Previously,  a  sepa¬ 
rate  study  was  required  to  develop  a  statistical  model  for  each  site  being 
tested  resulting  in  added  study  costs.  The  theoretical  model  removes  this 
necessity  while  providing  an  estimate  of  the  training  event  impacts. 
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6.5  Single  live  training  event— VDMTS  hardware  durability 

The  last  component  of  the  single  live  training  events  was  to  assess  hard¬ 
ware  durability.  The  success  metric  established  for  this  study  was  percent 
of  recorded  time  >  80%  of  the  actual  military  training  time.  Hardware  du¬ 
rability  in  single  events  was  assessed  at  Fort  Riley,  Fort  Benning,  and  PTA. 
The  data  in  Table  15  (p  72)  indicate  that  this  metric  was  met  at  all  three 
locations  with  a  total  of  85.5%  data  recorded  across  the  three  events. 

6.6  Live  training— VDMTS  hardware  durability 

The  hardware  durability  described  in  the  previous  section  was  also  assessed 
across  all  of  the  training  events  in  the  last  phase  of  the  demonstration.  For 
this  assessment,  the  success  criteria  established  was  percent  of  recorded 
time  >80%  of  training  time  per  vehicle  type  for  any  event.  The  success  met¬ 
ric  was  changed  to  investigate  durability  by  vehicle  type  to  determine  if 
hardware  durability  was  independent  of  the  vehicles  being  tracked. 

This  demonstration  tracked  14  training  events  at  three  locations,  totaling 
136  vehicles  tracked.  The  demonstration  resulted  in  13587.1  hours  logged 
out  of  15056.8  total  hours  of  training  resulting  in  VDMTS  units  recording 
90.2%  (±2.3%)  of  the  total  training  events  tracked.  In  every  event  but  two, 
>80%  of  the  data  were  collected  (77.8%  and  79.8%  on  13-15  July  2010  and 
10-17  May  2011,  respectively).  Separating  the  data  by  vehicle  type,  >80% 
of  the  data  were  collected  except  for  the  HEMTT  vehicle  (62.8  ±6.9%).  The 
reason  more  data  were  lost  on  the  HEMTT  vehicles  is  unclear.  This  could 
be  due  to  the  mounting  location  available  for  the  HEMTT.  Often  times,  the 
only  location  available  for  mounting  was  on  top  of  the  spare  tire  behind 
the  cab.  It  is  possible  that  this  mounting  surface  resulted  in  more  vibration 
or  movement  of  the  units  causing  more  data  faults.  The  lower  recording 
rates  in  the  HEMTT  vehicle  does  explain  the  low  collection  rate  on  the  10- 
17  May  2011  event  as  half  of  the  vehicles  being  tested  were  HEMTTs.  An¬ 
other  explanation  for  low  collection  rates  for  the  HEMTT  vehicles  is  that 
older  units  were  often  used  on  the  HEMTT  vehicles.  Troops  suggested  that 
that  these  vehicles  were  less  likely  to  travel  off-road.  In  an  effort  to  collect 
as  much  off-road  data  as  possible,  newer  units  were  mounted  on  vehicles 
more  likely  to  travel  off-road. 
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While  the  failure  of  data  collection  on  the  HEMTT  is  cause  for  some  con¬ 
cern,  the  influence  on  the  total  off-road  impacts  is  minor.  In  14  training 
tracked  events,  very  few  HEMTTs  were  observed  going  off-road.  A  lesson 
learned  from  these  demonstrations  was  that  care  should  be  taken  to  en¬ 
sure  the  units  are  mounted  as  securely  as  possible,  especially  when  mount¬ 
ing  units  on  the  HEMTT  vehicles. 

6.7  Live  training— Quantitative  ease  of  system  use 

The  system  ease  of  use  was  measured  quantitatively  by  determining  the 
time  required  to  perform  each  task  and  compare  with  a  time  deemed  ac¬ 
ceptable  in  the  approved  demonstration  plan.  The  success  criteria  were 
developed  through  discussion  with  installation  staff  and  ESTCP  manage¬ 
ment.  In  the  demonstration  plan,  the  success  metric  established  for  time 
required  for  analysis  was  40  hours  per  five  events  at  each  installation. 
Since  it  was  not  possible  to  track  five  events  at  both  installations,  the  suc¬ 
cess  metric  was  modified  to  8  hours  per  event  to  account.  Tables  25  and  26 
list  the  success  metrics  and  times  required  for  each  task.  In  every  case,  the 
system  met  the  success  metrics  established  (p  <  0.05).  This  indicates  the 
system  was  simple  enough  for  easy  implementation  into  the  management 
program  without  extensive  training  or  time  requirements. 


Table  25.  Training  summary  for  ease  of  system  use  assessment. 


Hardware  Use 
(hr/person) 

Data  QA/QC 
(hr/person) 

Analysis 

(hr/person) 

Success  Criteria  (Ho) 

4.0 

4.0 

16.0 

Average  Time  (hr) 

0.3 

1.07 

6.33 

Standard  Error  (hr) 

0.23 

0.35 

2.58 

T-test 

(average  time  <success  criteria) 

p  <  0.0001 

p  <  0.0001 

p  <  0.0001 

Table  26.  Summary  of  time  requirement  to  perform  each  step  in  the  VDMTS  process. 


Equipment 

Setup/Removal 

(hr/vehicle) 

Data  QA/QC 
(hr/Vehicle  File) 

Analysis 

(hr/Event) 

Success  Criteria  (Ho) 

1.0 

1.0 

8.0 

Average  Time  (hr) 

0.19 

0.82 

5.45 

Standard  Error  (hr) 

0.01 

0.02 

0.95 

T-test  (average  time  <success  criteria) 

p  <  0.0001 

p  <  0.0001 

p  =  0.00958 
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6.8  Live  training— Quantitative  quality  and  accuracy  of  data 

This  performance  objective  was  designed  to  test  the  hardware  and  model 
components  ability  to  produce  actionable  results  for  installation  land  manag¬ 
ers.  This  objective  had  two  components.  First,  to  determine  if  the  data  quality 
was  sufficient  for  use  as  inputs  in  models  (e.g.,  Fort  Riley  nLS  model, 
ATTACC)  used  in  land-use  decision  making.  Secondly,  it  was  designed  to  de¬ 
termine  if  the  data  quality  was  sufficient  to  identify  training  area  use  patterns. 
Identifying  training  area  use  patterns  assists  installation  land  managers  in 
identifying  the  following:  LRAM  sites,  low  water  crossing  usage,  emerging 
trails,  and  impact  to  TES  habitats  (e.g.,  RCW  and  Gopher  Tortoise).  The  data 
requirements  and  the  associated  success  criteria  for  each  objective  were  de¬ 
veloped  through  consultation  with  installation  land  managers  (e.g.,  ITAM 
and  Environmental)  as  well  as  regulation  authorities  (e.g.,  USFWS). 

The  first  metric  objective  was  to  assess  the  ability  to  use  the  data  for  pa¬ 
rameterization  of  land  management  models.  The  resolution  of  each  specif¬ 
ic  model  defines  the  acceptable  accuracy  of  data  for  model  parameteriza¬ 
tion.  If  the  demonstrated  accuracy  was  greater  than  the  model  resolution, 
the  data  quality  is  sufficient  for  model  parameterization.  The  data  types 
also  varied  with  the  input  requirements  of  the  model  of  interest.  In  the  ap¬ 
proved  demonstration  plan,  it  was  proposed  these  data  be  used  for  param¬ 
eterization  of  a  Kinematic  Wave  model  used  at  Fort  Riley  (nLS  model)  to 
predict  erosion  and  gully  formation.  It  was  also  proposed  to  use  the  data  to 
determine  better  estimates  of  Vehicle  Off- Road  Factor,  Vehicle  Severity 
Factor,  and  Vehicle  Conversion  Factor  for  use  in  ATTACC  methodology.  As 
described  in  Metric  8.1  in  Section  3.8.1  (p  32),  a  success  criterion  of  <  10  m 
positional  error  is  established.  Success  criteria  for  time  off-road,  vegeta¬ 
tion  loss,  and  IS  are  errors  less  than  20%.  Section  3.8  describes  the  meth¬ 
ods  for  obtaining  these  criteria. 

The  observed  accuracy  in  this  demonstration  for  each  data  type  are  1.6  m 
average  positional  error,  1%  error  in  estimating  time  off-road  and  6.3%  er¬ 
ror  predicting  IS.  These  measured  accuracies  meet  the  proposed  success 
criteria  for  each  data  type.  These  values  also  allow  determination  of  the 
ability  to  use  this  system  to  parameterize  different  models.  If  the  model 
requires  vehicle-tracking  data  and  uses  a  spatial  resolution  of  3  m,  the  ac¬ 
curacy  of  this  data  for  model  use  is  adequate.  However,  if  an  erosion  pre¬ 
diction  model  required  5%  accuracy  of  vegetation  cover  for  acceptable  re- 
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suits,  data  quality  from  the  VDMTS  process  (hardware  and  models)  is  not 
high  enough  for  implementation  in  the  model. 

The  second  metric  objective  was  to  determine  if  VDMTS  data  quality  is 
sufficient  to  identify  training  area  use  patterns.  Vehicle  positional  accuracy 
is  required  for  training  use  pattern  identification.  Some  pattern  identifica¬ 
tion  (i.e.,  LRAM  site  identification)  requires  vegetation  loss  predictions. 
Knowledge  of  training  relative  to  known  TES  habitat  locations  also  re¬ 
quires  vehicle  positional  data.  Vehicle  positional  accuracy  required  for 
LRAM  and  other  maintenance  requirements  was  determined  to  be  <  10  m 
positional  error.  For  TES  habitat  impact  analysis,  a  <  5  m  positional  error 
is  required.  Additionally,  <  20%  error  in  vegetation  removal  is  needed  for 
site  maintenance  requirements.  Metric  8.2  in  Section  3.8.2  (p  34)  docu¬ 
ments  the  development  of  these  success  criteria. 

The  observed  accuracy  in  this  demonstration  for  each  data  type  is  1.6  m 
average  positional  error  and  6.3%  error  in  vegetation  loss  estimation.  The¬ 
se  measured  accuracies  meet  the  proposed  success  criteria  for  each  data 
type.  Again,  this  approach  can  be  taken  to  determine  if  data  quality  is  ac¬ 
ceptable  for  any  training  area  use  pattern  quantification  and  analysis. 

6.9  Live  training— Qualitative  ease  of  system  use 

In  addition  to  quantitative  ease  of  use  metrics,  a  qualitative  ease  of  use 
metric  was  proposed  in  the  demonstration  plans.  This  was  aimed  at  de¬ 
termining  if  the  effort  required  to  training  a  technician  in  VDMTS  opera¬ 
tion  and  performance  of  tracking  events  and  data  analyses  was  acceptable. 
The  qualitative  metric  was  also  proposed  to  obtaining  any  feedback  from 
the  installation  technicians  on  use  of  the  systems  to  identify  any  draw¬ 
backs  to  the  system  and  learn  from  any  suggestions  they  may  have. 

To  test  this  metric,  each  technician  who  used  the  system  in  the  demonstra¬ 
tion  was  given  an  evaluation  form  (Appendix  D).  Technicians  only  filled  in 
the  evaluation  sections  relating  to  their  experience  with  the  system.  For 
each  step  of  the  data  collection,  they  were  asked  to  give  a  1-10  rating 
(where  10  indicates  no  issues  with  that  step,  and  1  indicates  an  unusa¬ 
ble/difficult  step).  To  supplement  the  small  sample  of  technicians,  addi¬ 
tional  students  from  the  University  of  Illinois  and  University  of  Tennessee 
(with  B.S.  and  M.S.  backgrounds  in  similar  fields  of  study  as  military  in¬ 
stallation  technicians  )  were  trained  and  asked  to  evaluate  the  system  and 
training.  Table  27  lists  the  results  of  these  evaluations.  An  average  rating 
>7  indicates  no  major  issues  with  that  step  in  the  VDMTS  process. 
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Table  27.  Summary  of  evaluation  forms  received  from  technicians  on  VDMTS  use. 


Task 

Average  Rating 

Comments 

Operation  of  vehicle¬ 
tracking  hardware 

9.3 

Overall,  VDM  boxes  were  fairly  easy  to  use. 

There  were  problems  w/the  magnetic  mounting  of  the  GPS 
sensor. 

Mounting  and  dismounting 
of  hardware 

8.7 

There  were  some  issues  mounting  boxes  to  vehicles  (i.e., 
finding  secure  place  to  mount  without  getting  in  way). 
Hardware  needs  to  be  places  securely  and  oriented  cor¬ 
rectly. 

Hardware  maintenance 
(e.g.,  charging/replacing 
batteries,  data  card  re¬ 
placement,  etc.) 

9.5 

The  new  units  were  easier  to  charge  than  older  models 
(pre-demonstration);  however  it  would  be  nice  to  have  bet¬ 
ter  access  to  the  data  card. 

Downloading  data 

10 

Checking  data  on  comput¬ 
er  for  errors  and  com¬ 
pleteness 

8.5 

Processing  raw  data  files 

7 

The  process  is  straightforward  and  simple,  but  takes  time 
to  complete  if  there  are  many  vehicles. 

Processing  data  to  deter¬ 
mine  vehicle  velocity  and 
turning  radius 

8 

Using  vehicle  impact  mod¬ 
els  for  prediction  of  im¬ 
pacts 

7 

Analyzing  impact  data  for 
site-specific  summaries 

8 

In  addition  to  the  questions  related  to  specific  tasks,  the  installation  staff 
members  were  asked  if  they  had  any  additional  comments  regarding  sys¬ 
tem  use.  One  PTA  staff  member  responded: 

I  really  love  the  new  tracking  units.  They  are  so  easy  to  work  with.  We  had  them 
inside  the  turret  with  the  antenna  stuck  on  the  top  of  the  vehicle.  I  hope  this 
worked  out  well  and  the  data  is  meaningful.  Vehicle  R-7  is  a  wrecker.  That  went 
out  on  the  maneuver  training  exercise.  I  would  like  to  track  the  damage  caused  by 
that  vehicle  as  it  weighs  another  10,000  lbs  I  believe.  I  wrote  the  weight  down  on 
one  of  those  sheets.  What  do  the  new  units  cost  to  put  together?  Can  I  get  the 
parts  to  make  my  own  here  in  Hawaii?  Can  you  put  together  a  parts  and  price  list 
so  that  I  can  start  to  do  this. 

The  qualitative  metric  was  a  good  way  to  document  feedback  from  installa¬ 
tion  staff  that  may  otherwise  be  lost.  Overall,  the  results  of  the  qualitative 
ease  of  use  metric  indicated  that  vehicle-tracking  units  were  easy  enough 
for  the  technicians  to  work  with.  There  were  a  few  comments  and  concerns 
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that  can  be  addressed  in  the  systems  in  the  future.  Since  the  VDM  units 
are  a  custom-built  product,  it  is  possible  to  request  certain  component 
changes  if  an  installation  requests. 

6.10  Live  training— Qualitative  quality  and  accuracy  of  data 

A  similar  qualitative  metric  was  proposed  to  assess  quality  and  accuracy  of 
data  for  land-use  decision  making.  This  metric  was  proposed  to  document 
issues  and  comments  installation  technicians  had  regarding  implementing 
the  VDMTS  process  in  their  programs.  Similar  to  the  previous  section,  an 
evaluation  form  was  given  to  each  technician  who  used  the  system  in  the 
demonstration.  (Appendix  D  includes  the  form.).  Technicians  only  filled  in 
the  evaluation  sections  relating  to  their  experience  with  the  system.  Table 
28  summarizes  the  responses  received  in  these  evaluation  forms. 

Installation  staff  members  were  also  asked  if  they  had  any  additional 
comments  regarding  implementation  of  the  system  into  their  program. 
Fort  Benning  staff  provided  the  following  comment: 

We  really  appreciate  the  support  from  ERDC/CERL  and  the  University  of  Tenn. 
in  executing  this  project  on  the  ground  so  quickly.  This  monitoring  support  was 
instrumental  in  gaining  the  confidence  and  approval  of  the  USFWS  in  addressing 
increased  vehicular  traffic  related  concerns  around  RCW  clusters  that  were  ad¬ 
dressed  in  a  biological  evaluation  of  effects  for  changes  to  the  Program  of  Instruc¬ 
tion  (POI)  for  the  ARC.  Additionally,  subsequent  vehicular  tracking  events  will 
augment  an  existing  research  project  (Heavy  Maneuver  Effects  on  RCWs)  which 
was  a  term  and  condition  of  the  jeopardy  biological  opinion  for  BRAC/MCoE  ac¬ 
tions  at  the  Installation.  Thanks,  Tim  Marston,  Lead  Wildlife  Biologist  -  RCW,  Ft. 
Benning,  GA. 

Figures  28  and  29  show  examples  of  data  analyzed  to  provide  Fort  Benning 
quantitative  data  for  training  time  near  RCW  clusters.  The  distance  thresh¬ 
olds  represent  distances  with  known  military  training  impacts  to  RCWs. 
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Table  28.  Summary  of  evaluation  forms  received  from  installation  land  managers  on  use  of 

data  collected  with  the  VDMTS. 


Issue 

Average  Rating 

Comments 

Data  collected 
are  of  value  for 
decision  making 

9.3 

This  will  be  very  useful  data  for  assessing  impacts  of  heavy 
maneuver  effects  on  RCWs  pertaining  to  the  Army  Recon¬ 
naissance  Course  (ARC)  when  providing  briefings  to  the 
USFWS  and  our  chain  of  command. 

Maps  produced 
from  data  aid  in 
visualization  and 
analysis  of  vehi¬ 
cle  use  patterns 
and  associated 
impacts 

9 

This  will  be  very  useful  data  for  assessing  impacts  of  heavy 
maneuver  effects  on  RCWs  pertaining  to  the  ARC  when 
providing  briefings  to  the  USFWS  and  our  chain  of  com¬ 
mand. 

Military  Training  Distance  from  RCW  Clusters 
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Figure  29.  Percent  of  training  time  within  certain  distances  of  RCW  clusters. 
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Fort  Riley  technicians  expressed  interest  in  incorporating  data  collected 
from  this  demonstration  plan  with  the  nLS  Gully  Formation  Prediction 
Model  (ESTCP  Project  RC  200820),  and  voiced  their  excitement  to  learn 
that  this  was  already  underway.  Additionally  at  both  Fort  Riley  and  PTA, 
implementation  of  the  VDMTS  process  was  incorporated  into  the  pro¬ 
posed  ITAM  5-year  plans. 

Overall,  while  this  demonstration  project  dealt  with  issues  relating  to  the 
ability  of  tracking  off-road  military  training  exercises,  at  every  location 
land  managers  expressed  their  eagerness  to  use  the  systems,  and  indicated 
that  they  could  see  how  the  data  collected  was  beneficial  to  their  needs  af¬ 
ter  seeing  the  process.  It  is  also  interesting  to  note  that  each  land  manager 
indicated  that  they  could  see  how  the  data  fit  into  their  programs  in  differ¬ 
ent  ways  (i.e.,  gross  estimation  of  expected  impacts  and  trail  development 
at  PTA  (Figures  30  and  31),  data  collection  for  predictive  models  and  ID  of 
LRAM  locations  at  Fort  Riley  (Figure  32),  and  quantification  of  training 
maneuver  patterns  related  to  RCW  nesting  trees  at  Fort  Benning  (Figures 
28  and  29).  As  such,  this  project  met  the  qualitative  quality  and  accuracy 
of  data  metric. 
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Figure  30.  Off-road  training  at  PTA.  Each  color  (red,  green,  and  blue)  represents  an  individual 
Stryker  vehicle.  Thicker  lines  represent  higher  DW  and  vegetation  removal  at  those  points. 
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Stryker  and  AAV:  Trail  Development 


Figure  31.  Identification  of  potential  areas  for  trail  hardening  at  newly  opened  training  area 
at  PTA.  Data  from  multiple  training  events  were  overlaid  to  identify  key  areas  trail 
development.  Different  colors  in  the  map  represent  individual  vehicle  tracks. 


Figure  32.  Example  of  training  intensity  map  developed  from  VDMTS  process.  Darker  colors 
indicate  more  time  spent  in  those  grid  cells. 
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7  Cost  Assessment 

A  main  objective  of  this  demonstration  was  to  provide  accurate  estimates 
of  VDMTS  implementation  costs  and  estimated  savings  in  land  manage¬ 
ment  costs. 

7.1  Cost  model 

Since  there  is  no  existing  technology  to  compare  costs,  several  other  tech¬ 
nology  cost  implementation  scenarios  were  evaluated.  Hardware  purchase 
and  replacement  costs  are  most  easily  summarized  in  “cost  per  event 
tracked.”  Data  analysis  costs  are  generally  based  on  a  “cost  per  question 
asked”  since  the  question  could  require  multiple  events  be  tracked  or  could 
reuse  previously  collected  data. 

To  resolve  the  issue  of  VDMTS  lifecycle  costs  existing  in  different  units 
(cost  per  event,  cost  per  question)  costs  were  estimated  for  several  imple¬ 
mentation  scenarios.  The  scenarios  were  intended  to  show  that  costs  vary 
between  installations  that  want  to  track  many  events  to  those  interested  in 
tracking  only  a  few.  The  scenarios  illustrate  costs  associated  with  different 
fielding  strategies,  from  those  that  rely  on  individual  installations  for  im¬ 
plementation  to  those  that  rely  on  regional  or  national  support  centers. 
Note  that  the  following  scenario  descriptions  are  hypothetical.  Table  30 
lists  the  cost  development  approach  for  the  scenarios,  which  were  derived 
from  interviews  with  installation  personnel: 

1.  Scenario  1.  An  installation  that  needs  to  track  several  events  to  answer  one 
management  question,  and  that  never  intend  to  use  the  technology  again. 
This  scenario  is  representative  of  an  installation  needing  to  track  military 
vehicles  to  assist  with  an  EIS  or  biological  assessment.  This  scenario  would 
track  20  vehicles  for  5,  l-week  long  events  over  a  period  of  1  year. 

2.  Scenario  2.  An  installation  that  needs  to  continually  track  a  certain  num¬ 
ber  of  events  each  year  for  an  indefinite  period  of  time.  This  scenario  is 
representative  of  an  installation  needing  to  track  military  vehicles  to  show 
compliance  with  an  established  policy  or  agreement.  This  scenario  would 
track  20  vehicles  for  10,  l-week  long  events  every  year  for  5  years. 

3.  Scenario  3.  An  Army  regional  support  center  provides  support  to  all  instal¬ 
lations  requiring  use  of  VDMTS  services.  This  could  also  be  a  contractor 
that  provides  vehicle-tracking  support  to  installations  under  contract.  This 
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scenario  is  representative  of  an  implementation  decision  to  support  multi¬ 
ple  installations  more  economically.  This  scenario  is  based  on  the  US  Ar¬ 
my  Sustainable  Range  Program  installation  support  model.  This  scenario 
would  potentially  include  to  installations  that  each  need  to  track  20  vehi¬ 
cles  for  10,  l-week  long  events  every  year  for  5  years. 

4.  Scenario  4.  Official  Army  weapon  and  training  system  data  (e.g.,  DFIRST, 
BFT)  become  available  to  provide  vehicle  static  and  dynamic  property  in¬ 
formation.  For  this  cost  analysis,  it  was  assumed  that  the  Army  users  (e.g., 
ITAM  and  Environmental)  would  have  access  to  these  data.  Therefore,  on¬ 
ly  data  analysis  costs  and  possibly  some  limited  data  acquisition  costs  are 
required.  Currently  however,  this  assumption  likely  does  not  hold  true  and 
acquisition  costs  (time  and  money)  would  be  higher  than  assumed.  This 
scenario  used  the  same  installation  requirements  as  Scenario  2  for  com¬ 
parison  (20  vehicles  for  10,  l-week  long  events  every  year  for  5  years). 

Table  29  summarizes  estimates  for  the  cost  elements.  Cost  elements  are 
the  main  cost  groups  associated  with  technology  use.  Sub-element  costs 
are  a  further  breakdown  of  costs  categories  associated  with  a  specific  cost 
element.  The  intent  of  this  table  is  to  identify  all  data  and  information  that 
were  tracked  through  demonstration  implementation.  These  data  were 
used  to  calculate  costs  for  each  scenario  (Table  30). 

7.2  Cost  drivers 

The  cost  drivers  for  implementing  the  VDMTS  process  and  determining 
which  application  and  technology  is  most  cost  effective  are  highly  depend¬ 
ent  on  the  specific  situation  at  each  installation  and  the  issues  being  ad¬ 
dressed.  For  example,  it  is  anticipated  that  larger  installations  with  more 
personnel  would  be  able  to  implement  the  VDMTS  process  in-house.  In 
contrast,  a  small  branch  (only  a  few  people)  at  a  smaller  installation  may 
need  to  hire  a  regional  support  center  to  perform  the  analyses  needed.  Ad¬ 
ditionally,  the  cost  for  implementing  the  system  depends  on  the  issues  be¬ 
ing  addressed  and  the  data  needed  to  answer  those  questions.  An  installa¬ 
tion  needing  to  track  only  a  few  events  could  hire  a  regional  support  center 
to  perform  the  analysis  required.  It  may  be  more  cost  effective,  however, 
for  the  installation  to  implement  the  system  in-house  if  many  training 
events  were  to  be  monitored  over  a  long  period  of  time  (5  years).  The  fol¬ 
lowing  section  expands  on  these  anticipated  cost  drivers  and  provides  rec¬ 
ommendations  for  system  implementation  given  different  scenarios. 


Table  29.  Cost  model. 


Cost  Element 

Cost  Sub-element 

Data  Tracked 

VDMTS  hardware  cost 

Purchase 

Initial  hardware  purchase  cost  reported  as  average  cost  per  vehicle-tracking  unit.  Initial  hardware  cost  data  collected  by  Cybernet  during 
system  production. 

Maintenance/ 

replacement 

Hardware  maintenance/replacement  cost  takes  into  account  life  expectancy  and  maintenance  costs.  Life  expectancy  is  estimated 
based  on  input  from  Cybernet  Systems.  Maintenance  costs  include  part  (e.g.,  battery,  switches,  etc.)  replacement  and  repair.  (Table  31 
lists  the  estimation  of  maintenance/replacement  cost.) 

Training 

Hardware 

Cost  of  labor  for  person  to  learn  how  to  operate  and  maintain  hardware.  Cost  is  based  on  number  on  hours  of  training  per  person 
trained  and  average  employee  cost/hour.  Cost  data  were  collected  during  single  and  multiple  tracking  event  activities. 

Data  processing 

Cost  of  labor  for  person  to  learn  data  processing  and  data  QA/QC  procedures.  Cost  is  based  on  number  of  hours  of  training  per  person 
trained  and  average  employee  cosi/hour.  Cost  data  were  collected  during  single  and  multiple  tracking  event  activities. 

Data  analysis 

Cost  of  labor  for  person  to  iearn  data  analysis  procedures.  Cost  is  based  on  number  of  hours  of  training  per  person  trained  and  average 
employee  cost/hour.  Cost  data  were  collected  during  single  and  multiple  tracking  event  activities. 

Event  tracking 

Event  tracking 

Preparation 

Labor  cost  to  maintain  and  prepare  systems  for  event  tracking.  Includes  battery  recharging,  minor  repairs,  and  system  performance 
checks.  Cost  based  on  average  time  per  tracking  unit  and  average  employee  cost/hour. 

VDMTS  setup 

Labor  cost  to  install  systems  in  the  field.  Cost  based  on  average  time  per  tracking  unit  and  average  employee  cost/hour.  Data  collected 
during  single  and  multiple  tracking  event  activities.  Generally,  these  costs  are  cost  per  event  tracked. 

VDMTS  removal 

Labor  cost  to  remove  systems  in  the  field.  Cost  based  on  average  time  per  tracking  unit  and  average  employee  cosi/hour.  Data  collected 
during  single  and  multiple  tracking  event  activities.  Generally,  these  costs  are  cost  per  event  tracked. 

Data  processing 

Labor  cost  to  download,  perform  quality  control,  and  pre-process  data.  Cost  based  on  average  labor  time  for  QA/QC  preprocessing  per 
tracking  unit  per  event  multiplied  by  average  labor  cost.  Data  collected  during  single  and  multiple  tracking  event  activities.  Generally, 
these  costs  are  cost  per  vehicle  tracked. 

Travel 

Travel  cost  associated  with  event  tracking.  This  cost  includes  airfare/rental  car  and  per  diem.  This  cost  is  estimated  since  travel  costs 
vary  depending  on  distance  and  location.  This  cost  is  necessary  to  accurately  assess  the  different  implementation  scenarios. 

Event  analysis 

Basic  summary 

Cost  to  perform  basic  analysis  of  vehicle-tracking  data.  This  includes  performing  impact  assessment  analysis  of  the  vehicle-tracking 
data  with  the  theoretical  models,  incorporating  data  into  GIS  environment,  and  performing  basic  event  summaries.  Cost  based  on  aver¬ 
age  labor  time  for  basic  vehicle  impact  summarization.  Generally,  these  costs  are  cost  per  vehicle  tracked.  Data  collected  during  single 
and  multiple  tracking  event  activities. 

Site/question-specific 

summary 

Data  interpretation/summarization  to  meet  land  management  objective.  This  could  be  the  percent  of  vegetation  removal  by  location, 
percent  time  off-road,  or  amount  of  time  vehicles  spent  in  TES  habitat.  Cost  based  on  average  labor  time  for  data  interpreta¬ 
tion/presentation  for  land  management  problem.  Cost  is  the  total  personnel  labor  multiplied  by  the  average  labor  cost.  This  cost  is  likely 
to  be  more  variable  than  other  costs  depending  on  the  question  asked.  Data  collected  during  single  and  multiple  tracking  event  activi¬ 
ties. 
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Table  30.  Cost  model  for  alternative  fielding  scenarios. 


Costing  Analysis  Scenario 

Cost  Element 

Cost  Sub-Element 

Installation  Performed 
(Scenarios  1  and  2) 

Regional  Support 

Center  (Scenario  3) 

Army  Standard  System 
(DFIRST/BFT)  (Scenario  4) 

Hardware 

Purchase 

$2900/unit 

$2900/unit 

NA 

Maintenance/replacement 

$32/unit/event 

$32/unit/event 

NA 

Training 

Hardware 

4  hr/class  *  $37/hr 

4  hr/class  *  $37/hr 

NA 

Data  processing 

4  hr/class  *  $37/hr 

4  hr/class  *  $37/hr 

4  hr/class  *  $37/hr 

Data  analysis 

16  hr/class  *  $53/hr 

16  hr/class  *  $53/hr 

16  hr/class  *  $53/hr 

Event  tracking 

Preparation 

0.5  hr/unit  *  $37/hr 

0.5  hr/unit  *  $37/hr 

0.0  hr/unit 

Setup 

0.3  hr/unit  *  $37/hr 

0.3  hr/unit  *  $37/hr 

0.0  hr/unit 

Removal 

0.1  hr/unit  *  $37/hr 

0.1  hr/unit  *  $37/hr 

0.0  hr/unit 

Data  processing 

1.0  hr/unit  *  $37/hr 

1.0  hr/unit  *  $37/hr 

1.0  hr/unit  *  $37/hr 

Travel 

$0/event 

$ 1500/event 

$0/event 

Event  Analysis 

Basic  summary 

1.0  hr/vehicle  *  $53/hr 

1.0  hr/vehicle  *  $53/hr 

1.0  hr/vehicle  *  $53/hr 

Site-specific  summary 

8.0  hr/summary  *  $53/hr 

8.0  hr/summary  *  $53/hr 

8.0hr/summary  *  $53/hr 

Total  Costs 

Purchase  costs 

$2900/unit 

$2900/unit 

$0 

Training  costs/individual 

$1144/individual 

$1144/individual 

$996/individual 

Fixed  cost/event 

$499/event 

$1999/event 

$424/event 

Cost/vehicle  tracked/event 

$123/vehicle 

$123/vehicle 

$90/vehicle 

Cost  for  proposed  scenarios 

Scenario  1: 

$76,954 

($ 7 6,954/yr/site) 

($15,391  event) 

Scenario  2: 

$237,244 

($47,449/yr/site) 

($4, 745/event) 

$2,649,288  ($53,185/yr/site) 

($5, 299/event) 

$112,196  ($22,439/yr/site) 

($2, 244/event) 

*  BFT  =  Blue  Force  Tracker 

DFIRST  =  Deployable  Force-on-Force  Instrumented  Range  System 

u> 
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7.3  Cost  analysis  and  comparison 

7.3.1  Monitoring  methods  and  costs 

A  cost  analysis  was  performed  for  the  scenarios  defined  in  Section  7.1 
(p  91)  using  the  data  collected  (Table  29).  The  cost  data  listed  in  Table  29 
were  collected  throughout  the  demonstration  from  a  number  of  sources. 
Hardware  costs  were  obtained  from  the  suppliers  (e.g.,  Cybernet,  parts 
suppliers,  etc.).  Hardware  maintenance  costs  were  calculated  from  the 
costs  observed  throughout  the  demonstration.  Time  requirements  for  each 
component  were  obtained  through  this  demonstration  (Performance  Ob¬ 
jective  7).  The  labor  costs  for  technicians  were  obtained  through  discus¬ 
sions  with  installation  managers  (average  labor  costs  per  technician  level) 
and  from  ITAM  program. 

The  demonstration  resulted  in  an  average  of  11  events  tracked  per  VDM 
tracking  unit.  Throughout  the  demonstration,  no  units  failed  to  the  point 
that  they  needed  replacement  (disregarding  minor  issues  like  battery  re¬ 
placement,  switch  replacement,  etc.)  This  does  not  allow  for  an  estimation 
of  unit  lifespan.  Based  on  discussions  with  the  unit  manufacturer  and 
based  on  observations  throughout  the  demonstration,  a  unit  lifespan  of 
100  events  was  estimated.  This  number  was  selected  as  a  conservative  es¬ 
timate  of  the  hardware’s  actual  lifespan.  The  design  of  the  hardware  is  a 
printed  circuit  board  with  all  surface  mount  components.  This  design  is 
very  resistant  to  physical  shock  and  vibration.  The  most  susceptible  points 
of  failure  are  the  SD  Card  connector,  electrical  power  connections  and 
switches,  and  GPS  antenna,  which  are  all  easily  replaced.  The  actual 
lifespan  depends  on  the  severity  of  the  conditions  the  unit  is  being  used  in, 
the  average  length  of  deployment,  and  other  factors. 

Because  the  cost  of  implementation  is  highly  dependent  on  the  situation 
for  which  it  is  being  used,  an  extensive  life  cycle  cost  analysis  is  difficult 
without  making  a  number  of  assumptions.  To  estimate  life  cycle  costs  and 
yearly  costs,  the  cost  analysis  approach  taken  is  to  assume  the  different 
scenarios  described  in  Section  7.1  (p  91).  A  lifecycle  cost  analysis  of  the 
hardware  was  performed  to  estimate  a  maintenance/replacement  cost  per 
event  (Table  31).  The  estimated  maintenance/replacement  cost  per  event 
was  used  in  the  scenario  costing  analysis  (Table  30)  to  account  for  the  cost 
per  event  to  repair  or  replace  each  unit  averaged  over  the  estimated 
lifespan  of  the  hardware. 
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Table  31.  Lifecycle  cost  analysis  of  VDMTS  hardware. 


Lifecycle  Cost  Component 

Cosi/unit 

Replacements 

Required/Lifespan 

Cosi/Lifespan 

Initial  purchase  cost 

$2,900.00 

1 

$2,900.00 

Battery  replacement 

$36.86 

2 

$73.72 

GPS  antenna  replacement 

$31.00 

1 

$31.00 

Switch  replacement 

$7.00 

2 

$14.00 

Wiring  and  connections 

$20.00 

2 

$40.00 

Misc.  Costs  (data  cards, 
card  connectors,  etc.) 

$30.00 

4 

$120.00 

Total  replacement  cost 

$3,178.72 

Estimated  Unit  Lifespan  (#  Events) 

100 

Maintenance-replacement  cost  per  event  per  unit 

$31.79 

As  shown  in  Figure  33,  a  regional  support  center  does  not  actually  reduce 
total  costs  to  the  Army  using  the  given  costs.  This  is  due  to  the  travel  costs 
required  for  technicians  to  reach  the  site.  The  cost  of  $i500/event  is  based 
on  airfare,  hotel,  and  per  diem  for  the  week  outweighs  any  benefit  the  re¬ 
gional  support  center  gives  from  a  reduction  in  equipment/labor  needed  per 
installation.  If  these  travel  costs  are  lower  (e.g.,  due  to  proximity  to  installa¬ 
tion),  the  slope  of  the  Regional  Support  Center  line  (shown  in  Figure  33)  is 
reduced  and  it  can  become  less  expensive  for  a  regional  support  center  to 
perform  the  studies.  For  example,  if  travel  costs  per  event  are  reduced  to 
$1000,  it  becomes  more  economical  for  a  regional  support  center  to  imple¬ 
ment  the  system  as  the  number  of  installations  becomes  greater  than  13. 

This  cost  analysis  is  limited  by  the  data  collected  through  this  demonstra¬ 
tion.  Since  this  demonstration  only  estimated  a  cost  requirement  to  per¬ 
form  the  VDMTS  process,  the  relationship  between  cost  and  number  of 
events  (or  installations)  is  a  linear  function.  This  assumption  is  accurate  in 
the  case  of  Scenario  1  and  2.  As  more  installations  adopt  the  VDMTS 
method  under  these  scenarios,  the  total  cost  to  the  military  increases  line¬ 
arly  as  the  efforts  are  replicated  for  each  installation.  In  the  case  of  Scenar¬ 
io  3,  as  the  number  of  events  tracked  increased,  the  cost  per  event  would 
decrease  due  to  economies  of  scale  (e.g.,  increased  efficiency  of  labor,  de¬ 
creased  analyses  times,  etc.).  However,  the  cost  data  collected  in  this 
demonstration  do  not  allow  for  the  determination  of  the  decreasing  costs 
per  event  collected  for  Scenario  3. 
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Number  Inst  a  nations 

Figure  33.  Total  cost  to  Army  from  different  scenarios  with  increasing  number  of  installations 
adopting  process  (Assumes  10  events  of  20  vehicles/event  at  each  installation  over  5  years 

at  the  costs  given  in  Tbl.  3  [p  22]). 

It  is  important  to  note  that  these  cost  analyses  assume  the  installation  (in 
the  case  of  Scenarios  l  and  2)  has  adequate  resources  to  support  the  sys¬ 
tem  implementation.  In  the  case  of  smaller  installations,  technicians  may 
not  be  available  or  have  the  skill  set  required  to  perform  the  vehicle  impact 
analyses.  In  these  cases,  it  is  more  economical  to  use  the  support  of  a  re¬ 
gional  center  to  implement  the  VDMTS  process. 

7.3.2  Alternative  monitoring  methods  and  costs 

Two  alternative  options  to  the  VDMTS  system  were  also  identified  through 
discussion  with  military  land  managers.  However,  the  VDMTS  process 
provides  land  managers  with  data  and  products  that  cannot  be  produced 
with  either  of  these  monitoring  methods.  This  cost  comparison  can  give  an 
idea  of  VDMTS  implementation  costs  compared  with  existing  monitoring 
costs.  However,  calculating  a  lifecycle  costs  savings  may  not  be  as  appro¬ 
priate  since  the  comparison  involves  different  technologies  and  issues. 

The  two  alternative  options  currently  being  employed  at  military  installa¬ 
tions  to  determine  locations  of  vehicle  training  impacts  and  gauge  the  se¬ 
verity  of  these  impacts  are  remote  sensing  and  “windshield  surveys.”  Fort 
Riley  is  currently  implementing  a  land  change  detection  model  based  on 
bi-monthly  250  m  resolution  Moderate  Resolution  Imaging 
Spectroradiometer  (MODIS)  data.  According  to  the  ITAM  coordinator, 
this  process  now  requires  a  GIS  analysis  approximately  2  hours  every  16 


ERDC/CERL  TR-12-11 


98 


days  to  update  the  dataset  and  perform  the  change  detection  analysis.  As¬ 
suming  a  rate  of  $53/hr  (Fringe  rate  for  GS12  Step  3)  that  results  in  oper¬ 
ating  costs  of  $2418.13  per  year.  However,  this  product  was  recently  de¬ 
veloped  and  is  currently  only  available  at  Fort  Riley.  As  such,  accurate  cost 
data  for  implementation  at  other  installations  are  not  available  for  com¬ 
parison  to  the  VDMTS  process. 

The  MODIS  land  change  detection  method  allows  for  a  quick,  low-cost  view 
of  change  detection  over  the  entire  installation.  This  data  can  be  calibrated 
with  bare  ground  and  biomass  data  collected  through  field  sampling.  Fort 
Riley  personnel  expressed  their  desire  to  use  both  the  high-quality,  high- 
resolution  data  collected  from  the  VDMTS  system  with  the  rapid,  low-cost 
remote  sensing  change  detection  data  collected  through  the  MODIS  land 
change  detection  model.  Integration  of  the  two  systems  would  allow  for 
timely,  continuous  land  condition  assessment  and  LRAM  intervention. 

The  second  alternative  option  is  the  “windshield  survey”  which  is  used  to 
determine  locations  of  highly  impacted  training  areas  and  locate  LRAM 
sites.  Fort  Riley  currently  employs  this  method.  The  ITAM  coordinator  es¬ 
timates  that  a  technician  ($38/hr  for  GS9  Fringe  Rate)  currently  spends 
approximately  2-3  hours  per  day  driving  through  the  training  areas  to 
identify  LRAM  sites.  Using  a  General  Services  Administration  (GSA)  pro¬ 
vided  $1. 24/mi  for  a  truck  and  assuming  an  average  velocity  of  30  mph, 
this  equates  to  $24,100.  Including  a  labor  cost  of  $24,700,  this  method  of 
LRAM  site  identification  costs  the  government  $48,8oo/year/installation. 
This  method  is  comparable  to  Scenario  2,  which  results  in  a  cost  of 
$47,449/yr/ installation. 

While  not  indicated  in  this  analysis,  the  cost  of  the  “windshield  survey”  is  a 
function  of  the  training  intensity  being  observed.  The  values  stated  are  for 
the  current  training  of  1-2  Brigades.  As  training  load  increases  in  coming 
years,  these  costs  will  also  increase.  While  VDMTS  implementation  does 
not  completely  eliminate  the  need  for  field  validation  of  these  sites,  track¬ 
ing  a  number  of  events  per  year  could  reduce  this  cost  and  free  technician 
time  to  repair  more  of  these  impacted  sites.  Additionally,  the  field  valida¬ 
tions  (“windshield  surveys”)  traditionally  do  not  detect  all  possibly  LRAM 
sites  due  to  lack  of  visibility  (e.g.,  vegetation  or  topography  preventing 
identification  of  highly  disturbed  sites  from  a  vehicle).  Another  added 
benefit  that  is  not  quantified  in  this  analysis  is  the  ability  to  use  the 
VDMTS  data  for  NEPA  and  ATTACC  reporting  and  assessments. 
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8  Implementation  Issues 

8.1  VDMTS  acceptance,  issues,  and  alternatives 

Once  individuals  used  the  VDMTS  units  and  used  the  data  they  collected, 
they  were  often  impressed  and  excited  to  implement  them  into  their  pro¬ 
grams.  Initially,  the  technicians  were  generally  hesitant  to  commit  too 
much  of  their  time  to  using  the  systems.  After  using  the  systems  once,  they 
were  often  surprised  by  the  lack  of  time  and  effort  required  to  collect  the 
data.  At  Fort  Riley  and  PTA,  the  use  of  the  VDMTS  system  was  imple¬ 
mented  into  the  installation  proposed  ITAM  5-year  plans.  Staff  at  a  third 
installation  requested  a  proposal  to  track  additional  training  events  after 
the  ESTCP  demonstration  project  to  support  an  existing  research  program 
on  base.  However  despite  the  installation  acceptance  of  the  process,  turn¬ 
over  at  ITAM  and  Environmental  installation  branches  may  result  in 
VDMTS  system  implementation  issues.  Additionally,  there  seems  to  be  lit¬ 
tle  continuity  in  programs  as  this  turnover  occurs.  An  original  installation 
staff  member  may  find  the  VDMTS  collected  data  and  analysis  invaluable 
towards  their  program;  however,  their  replacement  may  not  have  the  time 
or  desire  to  learn  how  the  system  could  support  their  work. 

Currently,  the  VDM  tracking  units  are  custom  built  by  Cybernet  Inc.  A 
lower  cost  alternative  (vehicle-tracking  system  [VTS]  unit)  without  the  INS 
tracking  capability  can  be  built  using  standard  commercial  off-the-shelf 
(COTS)  components.  User  manuals  for  the  VDM  units  are  supplied  in  Ap¬ 
pendix  C.  The  factors  involved  with  implementing  either  system  or  hiring  a 
regional  support  center  to  collect  tracking  data  are  summarized  in  Section 
7.3,  “Cost  analysis  and  comparison”  (p  95).  The  main  driver  for  these  deci¬ 
sions  is  the  availability  of  in-house  labor  and  capability  to  perform  simple 
analysis  of  the  vehicle-tracking  data. 

An  additional  option  for  implementation  involves  using  existing  military 
standard  systems  (Army’s  BFT  and  National  Guard’s  DFIRST)  which  ob¬ 
tain  vehicle  location  and  time  data  on  live  training  events  for  post-event 
analysis.  While  this  option  reduces  the  labor  required  for  the  collection  of 
vehicle  positional  information,  it  presents  a  whole  new  set  of  implementa¬ 
tion  issues.  The  primary  issue  involves  getting  permission  to  use  these  da¬ 
ta.  Some  of  these  data  are  classified  and  would  need  to  be  declassified  pri¬ 
or  to  obtaining  them.  Secondly,  the  quality  of  the  data  (positional  and 
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temporal)  may  not  match  those  validated  under  this  demonstration  plan. 

A  study  is  currently  being  performed  to  investigate  data  quality  from  these 
systems  compared  with  the  data  collected  from  the  VDM  and  VTS  systems. 

8.2  Technology  transfer  and  implementation 

The  demonstration  plans  outlined  multiple  methods  of  tech  transfer  and 
implementation  to  improve  military  land  management  decision  making. 
However  as  mentioned  in  the  previous  sections,  our  installation  hosts  often 
found  value  to  the  data  collected  through  this  work  in  ways  not  anticipated. 
The  following  section  describes  some  of  the  different  ways  the  data  collected 
through  this  project  have  been  used  outside  the  scope  of  this  project. 

Fort  Benning  found  value  in  characterization  of  vehicle  travel  and  training 
area  use.  Discussion  with  installation  staff  led  to  the  concept  of  analyzing 
vehicle-tracking  data  to  determine  distances  to  RCW  habitat.  Previous 
work  determined  flushing  responses  to  military  training  at  different  dis¬ 
tances.  These  data  allowed  Fort  Benning  to  begin  to  estimate  how  much  a 
certain  training  event  could  affect  populations.  Monitoring  the  vehicles 
with  VDM  tracking  units  was  instrumental  in  gaining  the  approval  of  the 
USFWS  to  allow  increased  vehicular  traffic  around  RCW  clusters  that  were 
due  to  changes  to  the  POI  for  the  ARC.  Coordination  with  Fort  Benning  is 
ongoing  to  augment  an  existing  research  project  aimed  at  investigating 
heavy  maneuver  effects  on  RCWs.  These  data  help  quantify  and  character¬ 
ize  the  extent  of  vehicular  training  in  RCW  habitat. 

This  project  enabled  support  of  an  Armor  School  Command  sponsored 
“Good  Hope  Soil  Disturbance  Demo”  project  at  Fort  Benning.  This  demon¬ 
stration  informed  command  on  expected  soil  disturbance  from  training 
events  in  the  newly  constructed  training  areas.  This  study,  in  turn,  gained 
support  by  supplying  quantitative  data  on  impacts  and  vehicle  maneuvers. 

Coordination  is  ongoing  with  ESTCP  Project  RC-200820  to  ensure  the  da¬ 
ta  collected  at  Fort  Riley  and  PTA  can  be  used  as  an  input  to  the  Kinematic 
Wave  Rapid  Soil  Erosion  Assessment  Model.  Vehicle-tracking  data  (vege¬ 
tation  removal  and  RD)  collected  at  PTA  have  been  used  in  the  model  to 
improve  estimation  of  vegetation  cover  maps  (bare  vs.  vegetation).  These 
data  can  also  improve  the  Digital  Elevation  Model  (DEM)  data  as  a  vehicle 
rut  can  concentrate  overland  flow  and  increase  the  probability  for  gully 
formation. 
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Data  collected  from  this  project  are  currently  informing  the  model  devel¬ 
opment  for  an  ERDC  6.2  study  Optimal  Allocation  of  Land  for  Training 
and  Non-Training  Uses  (OPAL).  The  objective  of  the  OPAL  work  package 
is  to  predict  impacts  for  cumulative  military  land-use  activities  and  pro¬ 
vide  optimization  routines  for  military  land  managers.  This  informs  land 
management  decisions  and  allows  for  estimation  of  past,  present,  and  fu¬ 
ture  impacts  given  historical  and  planned  land  use.  All  of  the  separate 
training  events  tracked  through  this  study  are  being  combined  into  a  sin¬ 
gle  database.  Impacts  and  training  distribution  will  be  characterized  be 
mission  type  allowing  more  accurate  predictions  of  impacts  from  planned 
training  events. 

The  theoretical  models  are  also  being  adapted  and  modified  for  improve¬ 
ment  of  vehicle  mobility  and  power  requirement  models.  A  US  Army  Tank 
Automotive  Research,  Development  and  Engineering  Center  (TARDEC) 
funded  project  titled  “Advanced  Vehicle/Terrain  Interaction  Modeling  to 
Support  Power  and  Energy  Analysis”  has  incorporated  the  DW  models  as 
well  as  the  soils  database  generated  through  this  demonstration’s  field 
studies. 

As  described  in  this  section,  this  project  was  successful  in  going  outside  of 
the  initial  project  scope  by  providing  interested  parties  data  and  summar¬ 
ies  for  improved  understanding  of  mission  impacts  to  soil  and  vegetation. 
This  is  partially  due  to  the  variety  of  backgrounds  of  personnel  who  were 
involved  with  this  project.  Data  and  summaries  from  this  project  were 
used  to  brief  the  Headquarters,  Department  of  the  Army  (HQDA)  ITAM 
Program  Manager,  USFWS  regulators  at  Fort  Benning,  and  training  com¬ 
mands.  People  from  varying  backgrounds  understood  how  the  data  col¬ 
lected  could  be  used  to  inform  their  land-use  and  training  decisions  and 
model  development.  Implementation  of  this  technology  requires  consider¬ 
ation  of  the  information  desired  and  the  different  options  for  data  collec¬ 
tion.  Decisions  to  implement  the  VDMTS  process  must  take  into  account 
the  question  being  asked  and  resources  available  to  the  installation. 
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9  Conclusions 

This  project  demonstrated  and  validated  the  VDMTS  system  and  its  com¬ 
ponents  through  a  series  of  controlled  field  studies  and  live  tracking  events 
at  Fort  Riley,  KS,  Fort  Benning,  GA,  Eglin  AFB,  FL  and  Pohakuloa  Train¬ 
ing  Area,  HI. 

This  demonstration/ validation  project  tested  and  validated  each  aspect  of 
the  VDMTS  process  at  multiple  levels,  specifically:  accuracy  of  the  hard¬ 
ware  and  models  in  combination;  durability  of  the  hardware  under  multi¬ 
ple  training  events;  ease  of  use  of  the  VDMTS  process;  and  ability  to  make 
land-use  decisions  based  on  the  VDMTS  collected  and  summarized  data. 
The  following  quantitative  metrics  were  tested  to  assess  each  aspect  of 
VDMTS  performance:  (l)  accurate  VDMTS  hardware  measurement  of  ve¬ 
hicle  dynamic  properties,  (2)  accurate  VDMTS  impact  model  predictions 
of  site  impacts  under  controlled  conditions,  (3)  accurate  VDMTS  hardware 
measurement  of  vehicle  static  and  dynamic  properties,  (4)  accurate 
VDMTS  model  predictions  of  site  impacts  during  live  training,  (5)  VDMTS 
hardware  durability  (in  single  live  training  event),  (6)  VDMTS  Hardware 
durability  over  14  live  training  events,  (7)  ease  of  system  use,  and  (8)  qual¬ 
ity  and  accuracy  of  data  for  land-use  decisions. 

The  following  hardware  performance  metrics  1,  3,  and  5-8  were  met:  . 
Metrics  2  and  4  (accurate  VDMTS  impact  models  predictions  in  controlled 
and  live  events)  did  not  meet  the  success  criteria  initially  proposed.  The 
demonstrated  average  error  for  disturbed  width  was  14.9  cm  and  the  aver¬ 
age  error  for  vegetation  removal  was  -1.8%.  These  results  are  comparable 
with  existing  site  and  vehicle-specific  empirical  model  predictions,  thus 
reducing  the  need  to  develop  models  for  each  site.  This  validates  the  use  of 
the  theoretical  models  for  impact  prediction. 

This  work  concludes  that  a  need  exists  for  a  system  that  can  produce  data 
and  analyses  like  the  VDMTS,  which  met  most  of  the  established  metrics, 
and  —while  it  failed  to  meet  some  metrics—  still  performed  as  well  as  pre¬ 
vious  methods  in  characterizing  vehicle  impacts,  reducing  the  relative  cost 
and  time  required. 
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The  results  of  this  work  clearly  show  that  this  technology  is  valuable  in  ob¬ 
taining  data  to  estimate  impacts  from  military  training.  Through  the 
course  of  the  project,  results  obtained  from  this  work  was  used  by  Inte¬ 
grated  Training  Area  Management  (ITAM)  program,  Environmental,  Di¬ 
rectorate  of  Public  Works  (DPW),  and  Training  groups.  Data  collected 
were  used  in  land  management  and  vehicle  mobility  and  power  models, 
and  study  results  also  informed  training  and  regulating  decisions. 
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Acronyms  and  Abbreviations 


Term 

Definition 

2DRMS 

Twice  Distance  Root  Mean  Square 

AAV 

Amphibious  Assault  Vehicle 

AFB 

Air  Force  Base 

ANSI 

American  National  Standards  Institute 

APC 

Armored  Personnel  Carrier 

ARC 

Army  Reconnaissance  Course 

ARRM 

Army  Range  Resource  Model 

ASABE 

American  Society  of  Agricultural  and  Biological  Engineers 

ASAE 

American  Society  of  Agricultural  Engineers 

ATTACC 

Army  Training  and  Testing  Area  Carrying  Capacity 

BFT 

Blue  Force  Tracking 

BRAC 

Base  Realignment  and  Closure 

CEERD 

US  Army  Corps  of  Engineers,  Engineer  Research  and  Development  Center 

CEP 

Circular  Error  Probable 

CERL 

Construction  Engineering  Research  Laboratory 

CFR 

Code  of  the  Federal  Regulations 

COTS 

Commercial  Off-The-Shelf 

CWA 

Clean  Water  Act 

DEM 

Digital  Elevation  Model 

D  FIRST 

Deployable  Force-on-Force  Instrumented  Range  System 

DGPS 

Differential  Global  Positioning  System 

DoD 

US  Department  of  Defense 

DPW 

Directorate  of  Public  Works 

DW 

Disturbed  Width 

EDYS 

Ecological  Simulation  Modeling 

EIS 

Environmental  Impact  Statement 

ELVS 

Evaluation  of  Land  Value  Study 

ERDC 

Engineer  Research  and  Development  Center 

ESA 

US  Endangered  Species  Act 

ESTCP 

Environmental  Security  Technology  Certification  Program 

GIS 

geographic  information  system 

GPS 

Geographic  Positioning  System 

GPS/INS 

Geographic  Positioning  and  Inertial  Navigation  System 

GS 

General  Schedule 

GSA 

General  Services  Administration 

HDOP 

Horizontal  Dilution  of  Precision 
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Term  Definition 


HEMTT  Heavy  Expanded  Mobility  Tactical  Truck 

HMMWV  High-Mobility  Multipurpose  Wheeled  Vehicle 

HQDA  Headquarters,  Department  of  the  Army 

ID  identification 

INS  Inertial  Navigation  System 

IS  Impact  Severity  (Vegetation  removal) 

ISTVS  International  Society  for  Terrain-Vehicle  Systems 

ITAM  Integrated  Training  Area  Management 

LAV  Light  Armored  Vehicle 

LCTA  Land  Condition  Trend  Analysis 

LMTV  Light  Medium  Tactical  Vehicle 

LRAM  Land  Repair  and  Maintenance 

MEMS  micro  electro  mechanical  systems 

MODIS  Moderate  Resolution  Imaging  Spectroradiometer 

MTV  Medium  Tactical  Vehicle 

NA  Not  Applicable 

NATO  North  Atlantic  Treaty  Organization 

NEPA  The  National  Environmental  Policy  Act 

NGA  National  Geospatial  Intelligence  Agency 

NPS  Nonpoint  Source 

NRMM  NATO  Reference  Mobility  Model 

NSN  National  Supply  Number 

0MB  Office  of  Management  and  Budget 

OPAL  Optimal  Allocation  of  Land  for  Training  and  Non-Training  Uses 

OTD  Office  of  the  Technical  Director 

PI  Principal  Investigator 

POI  Program  of  Instruction 

PTA  Pohakuloa  Training  Area 

QA/QC  Quality  Assurance/Quality  Control 

ROW  Red-cockaded  Woodpecker 

RD  Rut  Depth 

RFMSS  Range  Facility  Management  Support  System 

RTLA  Range  and  Training  Land  Assessment  Program 

SAE  Society  of  Automotive  Engineers 

SAR  SAME  As  Report 

SAT  Satellite 

SBIR  Small  Business  Innovation  Research 

SD  Secure  Digital 

SERDP  Strategic  Environmental  Research  and  Development  Program 
SF  standard  form 


RFMSS 
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Appendix  A:  Points  of  Contact 


Point  of  Contact 

Name 

Organization 

Name,  Address 

Phone,  Fax,  E-Mail 

Role  in  Project 

Daniel  Koch 

ERDC-CERL 

2902  Newmark  Drive 
Champaign,  IL  61822 

217-373-4552 

217-373-7266 

daniel.j.koch@usace.army.mil 

Principal  Investi¬ 
gator  (PI) 

Dr.  Paul  Ayers 

University  of  Tennessee 
2506  E.J.  Chapman 

Drive 

Knoxville,  TN  37996 

865-974-4942 

865-974-4514 

pdayers@utk.edu 

Co-investigator 

Heidi  Howard 

ERDC-CERL 

2902  Newmark  Drive 
Champaign,  IL  61822 

217-373-5865 

217-373-7266 

heidi.r.howard@usace.army.mil 

Co-investigator 

Gary  Siebert 

Cybernet  Systems  Corp. 

3885  Research  Park 
Drive 

Ann  Arbor,  Ml  48108 

734-668-2567  xl50 

734-668-8780 

gary@cybernet.com 

Co-investigator 
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Appendix  B:  List  of  Vehicles  Tracked  by  Date 
and  Location 


Dates 

Location 

Card  # 

Vehicle  #/ID 

Vehicle  Type 

18-20  Oct  2010 

Fort  Benning 

2 

LT  206 

Bradley 

18-20  Oct  2010 

Fort  Benning 

11 

LT  187 

Bradley 

18-20  Oct  2010 

Fort  Benning 

12 

53 

Stryker 

18-20  Oct  2010 

Fort  Benning 

14 

55 

Stryker 

18-20  Oct  2010 

Fort  Benning 

18 

54 

Stryker 

18-20  Oct  2010 

Fort  Benning 

10 

55 

Stryker 

18-20  Oct  2010 

Fort  Benning 

14 

LT  187 

Bradley 

18-20  Oct  2010 

Fort  Benning 

17 

LT  206 

Bradley 

18-20  Oct  2010 

Fort  Benning 

21 

54 

Stryker 

28-29  Mar  2011 

Fort  Benning 

11 

STR01 

Stryker 

28-29  Mar  2011 

Fort  Benning 

18 

LT-159T 

Bradley 

28-29  Mar  2011 

Fort  Benning 

25 

SEP1.1 

Abrams 

28-29  Mar  2011 

Fort  Benning 

9 

LT-159T 

Bradley 

28-29  Mar  2011 

Fort  Benning 

11 

STR01 

Stryker 

28-29  Mar  2011 

Fort  Benning 

12 

LW391 

HMMWV 

28-29  Mar  2011 

Fort  Benning 

19 

SEP1.2 

Abrams 

1-3  Nov  2011 

Fort  Benning 

2 

LW310/LW133 

HMMWV 

1-3  Nov  2011 

Fort  Benning 

3 

STR07 

Stryker 

1-3  Nov  2011 

Fort  Benning 

5 

LW058 

HMMWV 

1-3  Nov  2011 

Fort  Benning 

8 

LW601 

HMMWV 

1-3  Nov  2011 

Fort  Benning 

9 

LW261 

HMMWV 

1-3  Nov  2011 

Fort  Benning 

11 

STR18 

Stryker 

1-3  Nov  2011 

Fort  Benning 

12 

LW057 

HMMWV 

1-3  Nov  2011 

Fort  Benning 

13 

STR05 

Stryker 

1-3  Nov  2011 

Fort  Benning 

17 

LW598 

HMMWV 

1-3  Nov  2011 

Fort  Benning 

19 

LW324 

HMMWV 

1-3  Nov  2011 

Fort  Benning 

20 

LW414 

HMMWV 

1-3  Nov  2011 

Fort  Benning 

15 

STR11 

Stryker 

1-3  Nov  2011 

Fort  Benning 

4 

LW318 

HMMWV 

1-3  Nov  2011 

Fort  Benning 

21 

LW314 

HMMWV 

1-3  Nov  2011 

Fort  Benning 

116 

LW138 

HMMWV 

1-3  Nov  2011 

Fort  Benning 

111 

LW266 

HMMWV 

1-3  Nov  2011 

Fort  Benning 

114 

LW602 

HMMWV 

1-3  Nov  2011 

Fort  Benning 

102 

LW413 

HMMWV 
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Dates 


1-3  Nov  2011 
1-3  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
10-13  Nov  2011 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 
17-21  Aug  2009 


Location 


Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Benning 
Fort  Riley 
Fort  Riley 
Fort  Riley 
Fort  Riley 
Fort  Riley 
Fort  Riley 
Fort  Riley 
Fort  Riley 
Fort  Riley 
Fort  Riley 
Fort  Riley 
Fort  Riley 
Fort  Riley 
Fort  Riley 
Fort  Riley 
Fort  Riley 


Card  # 


Vehicle  #/ID 


123 

LW247 

104 

LW131 

22 

LW310 

10 

STR07 

1 

LW058 

6 

LW602 

27 

LW601 

24 

LW261 

26 

STR18 

29 

LW057 

108 

STR05 

16 

LW598 

25 

LW324 

7 

LW414 

18 

STR11 

14 

LW318 

28 

LW314 

100 

LW131 

105 

LW247 

101 

LW266 

103 

LW413 

104.2 

LW259 

116 

LW138 

111.2 

LW310 

ey 

1 

1 

ey 

2 

2 

ey 

4 

4 

ey 

5 

5 

ey 

6 

6 

ey 

9 

9 

ey 

10 

10 

ey 

11 

11 

ey 

12 

12 

ey 

13 

13 

ey 

15 

15 

ey 

16 

16 

ey 

17 

17 

ey 

18 

18 

ey 

19 

19 

ey 

22 

22 

Vehicle  Type 


HMMWV 

HMMWV 

HMMWV 

Stryker 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

Stryker 

HMMWV 

Stryker 

HMMWV 

HMMWV 

HMMWV 

Stryker 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

MTV 

HMMWV 

HMMWV 

MTV 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

MTV 

HMMWV 

MTV 

HMMWV 

MTV 

Buffalo 
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Dates 


17-21  Aug  2009 
17-21  Aug  2009 
13-15  Jul  2010 
13-15  Jul  2010 
13-15  Jul  2010 
13-15  Jul  2010 
13-15  Jul  2010 
13-15  Jul  2010 
13-15  Jul  2010 
10-17  May  2011 
10-17  May  2011 
10-17  May  2011 
10-17  May  2011 
10-17  May  2011 
10-17  May  2011 
10-17  May  2011 
10-17  May  2011 
10-17  May  2011 
10-17  May  2011 
10-17  May  2011 
10-17  May  2011 
17-22  May  2011 
17-22  May  2011 
17-22  May  2011 
17-22  May  2011 
17-22  May  2011 
17-22  May  2011 
17-22  May  2011 
17-22  May  2011 
17-22  May  2011 
17-22  May  2011 
17-22  May  2011 
6-9  Nov  2009 
6-9  Nov  2009 
6-9  Nov  2009 
24-29  Jan  2010 
24-29  Jan  2010 
24-29  Jan  2010 
24-29  Jan  2010 
24-29  Jan  2010 


Location 


Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
Fort  R 
PTA 
PTA 
PTA 
PTA 
PTA 
PTA 
PTA 
PTA 


Card  # 


24 

25 

3 

4 

5 

7 

8 
9 


Vehicle  #/ID 


10 

10 

2 

FSC-120 

4 

FSC-101 

5 

FSC-172 

10 

FSC-52 

6 

FSC-102 

7 

FSC-51 

4 

FSC-161 

5 

FSC-80 

9 

FSC-172 

11 

FSC-60 

15 

FSC-181 

19 

FSC-120 

1 

FSC-102 

3 

FSC-101 

5.2 

FSC-120 

8 

FSC-52 

9 

FSC-172 

8 

FSC-80 

107 

FSC-172 

108 

FSC-120 

110 

FSC-181 

R06 

FSC-60 

R17 

FSC-51 

18 

PTA18 

17 

PTA17 

19 

PTA19 

4 

PTA04 

7 

PTA07 

9 

PTA09 

14 

PTA14 

15 

PTA15 

Vehicle  Type 


MTV 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

HMMWV 

5  Ton  6x6 

HMMWV 

HEMTT 

LMTV 

HEMTT 

HEMTT 

HEMTT 

HMMWV 

HEMTT 

LMTV 

HEMTT 

HMMWV 

HMMWV 

HEMTT 

HEMTT 

HMMWV 

HEMTT 

LMTV 

HEMTT 

LMTV 

HMMWV 

HMMWV 

HEMTT 

HEMTT 

Stryker 

Stryker 

Stryker 

AAV 

AAV 

AAV 

AAV 

AAV 
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Appendix  C:  Vehicle  Dynamic  Monitor  User 
Guide 


Vehicle  Dynamic  Monitor 

Intro  to  VDM  VDM  technical  VDManaly- 
installation:  instruction  sis  software 

GPS  connection  Instruction 

and  mounting 
procedure 


Cybernet  Systems  Corporation 
U.S.  Army  Corps  of  Engineering 
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Questions  should  be  directed  toward  the  contacts 
listed  below: 

Trevor  Davey 

Cybernet  Systems  Corporation 
727  Airport  Blvd. 

Ann  Arbor,  Ml  48108 
734-668-2567  ext.  112 
tdavey@cybernet.com 


Gary  Siebert 
Cybernet  Systems  Corp. 
727  Airport  Blvd. 

Ann  Arbor,  MI  48108 
Ph  (734)  668  2567x150 
Fax  (734)  668-8780 
gary#cybernet.com 


Cybernet  Systems  Corporation 


Daniel  Koch 
ERDC-CERL 
2902  Newmark  Drive 
Champaign, IL  61822 
Office:  217-373-4552 
Cell:  217-637-3689 
Fax:217-373-7251 


Heidi  Howard 
ERDC-CERL 
2902  Newmark  Drive 
Champaign,  I L  61822 
Office:  217-373  -5865 
Cell:  217-377-8504 
Fax:217-373-7251 


U.S.  Army  Corps  of  Engineering 
Construction  Engineering 
Research  Lab 
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Vehicle  Dynamic  Moniter  (VDM):  1 
Introduction 


Introduction  to  the 
VDMTS  Process 


The  Vehicle  Dynamics  Monitoring  and  Tracking  System  ( VDMTS)  can  be  used  to  assess 
and  predict  military  vehicle  maneuver  training  impacts  for  use  in  land  management  decision¬ 
making  processes  and  National  Environmental  Policy  Act  (NEPA)  analyses.  The  approach 
spatially  characterizes  short-term,  direct  impacts  resulting  from  vehicles  by  monitoring 
individual  vehicle  locations  and  operating  characteristics  (i.e.  turning  radius  and  velocity). 
Vehicle  impact  models  are  used  to  predict  area  impacted,  vegetation  loss,  and  rut  depth,  and 
are  based  on  vehicle  operating  characteristics  and  location.  Analysis  routines  are  used  to 
summarize  use  patterns  and  the  severity  ofcuiuulative  impacts. 

'The  VDMTS  process  consists  of  three  components:  1)  vehicle  impact  models,  2)  vehicle 
tracking  hardware  and  software,  and  3)  vehicle  tracking  data  analysis.  This  document  is  a 
User’s  Manual  for  the  Vehicle  Dynamic  Monitor  (VDM):  the  hardware  and  software  com 
ponent  of  the  VDMTS.  It  contains  information  on  data  collection  processes,  maintaining 
the  hardware,  operating  the  software,  and  technical  information  regarding  the  data  collected. 

The  vehicle  tracking  hardware  and  software  measure  vehicle  kinematics, dynamics,  and  other 
parameters  of  interest  that  enable  accurate  modeling  of  environmental  impact.  Innovative 
sensor  fusion  software  combines  data  from  these  sensors  to  provide  position  information 
even  during  GPS  outage.  The  system  thereby  provides  vehicle  dynamics  data  and  positional 
information  at  all  times,  even  when  GPS  is  unavailable.  The  VDMTS  has  the  capability 
to  record  the  vehicle  dynamics  tagged  with  position  information  for  post-mission  analysis. 
Vehicle  tracking  visualization  software  resides  on  a  user’s  desktop  that  provides  simple  visual 
access  to  the  VDMTS  data  within  a  GIS  environment. 
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Vehicle  Dynamic  Moniter  (VDM):  2 

Equipment/Setup 


Setting  up  the 

Vehicle  Dynamic  Monitor  (VDM) 


Equipment 


Connecting  the  Device 


The  VDM  comes  packaged  in  a  Pelican  Case.  It 
includes  the  following  components: 


1.  VDM  Module1 2 3 4 5 6 7 

2.  Battery* 

3.  GPS  Antenna* 

4.  SD  Card* 

5.  Powcr/Charging  Cable* 

6.  Pelican  Case 

7.  Battery  Charger 


*'Jhese  items  are  all  internal  to  the  Pelican  Case. 
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Vehicle  Dynamic  Moniter  (VDM):  I  3 
Mounting/ Operating  VDM  | 


Mounting  the  VDM 

Tlie  VDM  should  be  mounted  securely  to  the  test 
vehicle.  It  must  always  be  mounted  with  one  axis 
parallel  to  the  vertical’s  axis  of  forward  motion. 
Figure  2  is  a  diagram  of  good  vs.  bad  mounting 
orientations. 


Good  Bad  Good 


Figure  2.  good  vs.  bad  mounting  orientation 


It  does  nor  need  to  be  parallel  with  the  ground. 
Mounting  the  VDM  on  an  angle  is  acceptable  and 
an  example  can  be  seen  in  Figure  3.  Always  note 
the  axiz  of  vehicle  movement,  for  future  use  in  the 
VDM  analysis  software.  (See  figure  7.  on  page  8) 


Figure  3:  Mounting  the  VDM  at  an  Angie 


Turning  on  and  Operating  the  VDM  module 

The  Vehicle  Dynamic  Monitor  (VDM)  is  a  small 
electronic  device  with  GPS  and  internal  sensors. 
The  VDM  unit  logs  sensor  data  along  with  GPS 
position  to  a  removable  Secure  Digital  Card  (SI) 
Card).  Make  sure  to  delete  all  Log  files  from  the 
SD  card.  For  a  new  SD  card  make  sure  the  SD 
card  is  empty  and  formatted.  If  not  follow  the 
manufacturer’s  instruction  for  formatting  the  SD 
card.  Note  only  the  standard  FAT  file  system  is 
supported . 


The  VDM  unit  has  2  operational  modes:  Auto 
Logging  Mode  and  Manual  Mode. 


Auto  Logging  Mode  (default) 


1.  To  power  up  the  VDM  toggle  the  power 
switch  to  the  on  position.  The  GPS,  INS, 
and  Error  LEDs  will  come  on  momentarily 
and  then  will  turn  off. 

2.  Once  the  system  has  booted  llie  unit  will 
then  enter  motion  sensing  sleep  mode. 

3.  When  vehicle  motion  (start  of  the  engine) 
has  been  detected  the  unit  will  wake  up 
and  begin  to  log  dara. 

4.  Let  the  vehicle  idle  for  1  minute  before 
driving.  This  will  allow  the  GPS  to  get  a 
position  fix  and  for  the  VDM  to  self 
calibrate. 

5.  While  the  unit  is  logging  the  INS  LED 
will  blink  rapidly  and  the  GPS  LED  will 
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Vehicle  Dynamic  Moniter  (VDM): 
Operating  VDM/  Shutting  Down  VDM 


4 


blink  on  and  off  slowly  while  waiting  for  a 
GPS  fix.  When  the  GPS  is  receiving 
position  fixes  the  G  PS  LED  will  blink  on 
quickly. 

6.  If  the  vehicle  motion  stops  the  VDM  will 
stop  logging  and  go  back  into  motion 
sensing  sleep  mode. 

7.  At  any  time  during  the  logging  period 
the  user  can  put  the  VDM  back  into 
motion  sensing  sleep  mode  by  pressing 
and  releasing  the  Stop  button. 

NOTE:  At  this  point  the  unit  will  begin 
logging  data  again  unless  the  Stop  button 
is  pressed  a  second  time  within  3  seconds 
to  power  the  unit  down. 

8.  To  power  down  the  VDM,  make  sure 
that  it  is  not  logging.  All  LEDs  will  be  off 
in  this  situation.  Next,  press  the  Stop 
button  and  verity  that  the  Error  LED 
blinks  4  times.  Toggle  the  power  switch  to 
the  off  position. 


Manual  Logging 

At  any  time  while  in  Auto  Logging  Mode  the 
VDM  can  be  forced  to  log  data  manually. 


1.  Pressing  and  releasing  the  Start  button 
will  force  the  VDM  to  log  data  manually. 
Once  manual  logging  has  been  initiated 
the  unit  will  only  stop  logging  with  use  of 
the  Stop  button. 

2.  Pressing  and  releasing  the  Stop  button 
will  stop  logging  and  return  the  VDM  to 
motion  sensing  sleep  mode. 


SD  Card  Reader  Mode 


1)  Before  powering  up  the  unit  press  and  hold 
the  Stop  button. 

2)  Continue  to  hold  the  Stop  button  and 
toggle  the  power  switch  to  the  on  position. 

3)  The  VDM  will  enter  SD  card  reader 
mode  and  will  turn  on  the  INS  and  GPS 
LEDs  when  the  USB  cable  is  connected 
and  configured  correctly. 

4)  The  user  can  now  read  and  write  to  the  SD 
card  from  the  PC. 

5)  To  power  down  the  VDM,  follow  the  PC’s 
steps  to  safely  remove  a  USB  device. 

When  the  device  is  safe  to  remove, 
disconnect  the  USB  cable  and  toggle  the 
power  switch  to  the  off  position. 


If,  at  any  point  in  time  the  Error  LED  turns  on 
please  refer  to  the  troubleshooting  section. 

Verifying  the  data  /  Shutting  down  the  VDM 

To  verify  logging  after  the  VDM  has  been  started, 
start  the  vehicle  in  which  the  VDM  is  installed. 
The  LEDs  should  perform  as  described  in  the 
“Operational  Summary”  (Note  when  used  in  a 
pelican  case  the  case  must  be  opened  to  view  the 
LEDs). 

To  power  down  the  VDM,  make  sure  that  it  is 
not  logging  (Press  and  release  the  Stop  button  if  it 
is).  Verify  all  LEDs  are  off.  Next,  press  the  Stop 
button  and  verify  that  the  Error  LED  blinks  4 
times. 

Toggle  the  power  toggle  switch  to  the  “OFF” 
position. 


The  VDM  can  be  started  as  a  SD  card  reader 
mode.  This  will  allow  for  retrieval  of  the  data 
through  the  USB  port  and  eliminate  the  need  to 
remove  the  SD  card. 
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Vehicle  Dynamic  Moniter  (VDM):  5 
Downloading  Data/ Charging  Battery 


Downloading  Data 


Charging  the  Battery  Module 


There  are  two  wavs  to  access  the  VDM  log  files: 

1.  By  removing  the  secure  digital  card  and  2. 
through  a  USB  connection  to  the  PC.  To  access 
the  log  files  via  the  SD  card  you  wdl  need  a  SD 
card  reader.  To  access  the  log  files  via  USB  you 
will  need  a  USB  Type  A  to  mini-USB  Type  B 
cable  (not  included). 


Via  SD  Card 


1. 

If  the  VDM  module  is  powered  on  follow 
the  instructions  to  power  down  the  VDM 
module. 

2. 

Once  the  VDM  is  powered  down  press 
the  SD  card  in  and  it  will  automatically 
eject  itself  from  rhe  VDM. 

3. 

Place  the  SD  card  in  a  SD  card  reader  and 
Copy,  Move,  Manipulate,  and  Delete  the 
log  files  as  required. 

4. 

Return  the  SD  card  to  the  VDM  for 
further  data  logging. 

Via  USB 

i. 

'Ihe  VDM  must  be  powered  up  in  rhe  “SD 
Card  Reader  Mode.” 

2. 

Plug  in  the  USB  cable  and  navigate  to  the 
desired  directory.  Copy,  Move,  Manipulate 
and  Delete  the  log  files  as  required. 

3. 

Request  a  safe  removal  of  the  hardware 
from  the  operating  system. 

4. 

When  it  is  safe  to  remove  the  hardware, 
the  VDM  can  be  disconnected  and  power 
down  by  putting  the  toggle  switch  into  the 
“OFF”  position. 

1.  Toggle  rhe  power  switch  to  the  “OFF” 
position 

2.  Connect  the  batter}'  charger  to  a  120 VAC 
power  outlet.  As  shown  in  Figure  4 

3.  Connect  the  battery  charger  jack  to  the 
batter}'  charging  cable  plug. 

4.  Verify  the  charging  indicator  is  solid  Red 
or  Green.  An  LED  status  chart  can  be 
seen  in  Figure  5. 


STATUS 
RAPID  CHARGE 
FUU-  CHARGE 

ERROR _ 

BATTERY  ABSENT 


Figure  5.  Battery  Charger  LEDStatus  Chart 
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Vehicle  Dynamic  Moniter  (VDM):  I  6 
Trouble  Shooting  | 


Error  Indications 


Errors  arc  indicated  with  Ihc  Error  LED. 

Indication  Error 


ON 

There  is  no  SD  card 
connected  to  the  VDM 

1  Blink  per  second 

2  Blinks  per  second 

3  Blinks  per  second 

4  Blinks  per  second 

Technical  support  and  product  service 

If  you  experience  difficulty  getling  your  VDM 
operating  properly  please  contact  Cybernet's 
Technical  support.  Our  Technical  staff  is  available 
by  phone  9:00-5:00  Eastern  Standard  time  at 
734.668.2567  or  by  e-mail  at  support@cybernet. 
com 

Please  refer  to  your  product  technical  support 
agreement  if  support  beyond  the  initial  support 
period. 

On-Line  Support 

On  Line  support  is  available  through  the 
following  services. 

E  mail:  support@cybernet.com 
Website:  http://www.cybernet.com/VDM 
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Vehicle  Dynamic  Moniter  (VDM):  I  7 
Technical  Instruction  | 


Vehicle  Dynamic  Monitor  (VDM) 
Technical  Instruction 


Log  File  Name 

The  VDM  generates  a  new  log  file  ever  time  it 
wakes  and  begins  logging.  The  log  file  name 
format  follows,  where  xxxx  is  a  sequential  number 
corresponding  to  the  number  of  files  that  have 
been  created. 

LOG_XXXX.VDM 

An  example  set  of  files  follows: 

LOG_0001 . VDM 
LOG_0002.VDM 
LOG_0 003. VDM 
LOG_0004 .VDM 

Log  File  Header 

Each  log  file  begins  with  a  header  attachment 
that  provides  information  about  how  the  data  was 
collected.  An  example  header  can  be  seen  below. 
The  first  line  is  the  software  version  identifier. 

The  second  line  is  a  serial  number  that  identifies 
what  VDM  was  used  to  collect  the  data.  Finally, 
the  third  line  indicates  whether  the  VDM  started 
collecting  data  using  its  automatic  feature  or  by 
depression  of  the  manual  start  button. 

#VDM  Logger  :  Verl .  1 

S00000002 

SVDM  Auto  Start 


VDM  Protocol 

The  VDM  records  inertial  and  temperature  data  at 
a  rate  of  100Hz  and  GPS  data  at  1  Hz.  A  sample 
section  of  data  can  be  seen  below.  The  inertial 
string  starts  with  an  T(for  inertial)  and  the  GPS 
starts  with  a  ‘G’  (for  GPS). 

iMM»m(tiMis»rrr«MMrfrioivfMrT>fK«oK?«r»r44«G*«r7M«or«fiir}r«j«oi>rii'*i4« 
iM04»?*Bt<8  !>r  (xtoozisartAiciotbiMir  i  nmur  <«i»n.’*eu«inn*u»*iiiir;r».noU(  mu  m 
iM04»ra?«>n  nr>«MDOftMarrifc»oiMMri*«EBor74»r4*4oatii>4Ma»<4iBr  )04>i*oo»«kbi44 
iM04»?aB|s8lTTt(arrcMM4|cl0i0|Mrcjk«E8ai:cir*rl»luftB2  3|M0r4|iBri«hi«00MKa>4l 
I8804»7m(8  ITrtM00«4aar>rfCI07r«MrT  HEBOrOWBf  l»fBB87MHa0r»f IBr)OtJBOOC4KB  144 
iMO4»70r«>0B*7t«*rr74«OB*4trBO4l4MrT»0R0ai<0«rar4l8o089MH00r»8ior30BJ«0Or0K0}4< 
14404»7»»llMMSPaai.lt44tO  00 , 471 1.8771* .  8  ,88  M4  ,J1  »7  1 ,88 . 1  .41 ,7>*  ,  >  M .  M 
IB804B?  JL94S8 1TV  888007  4*8  88  )$C80704MrT>8E80KMnr4 1  8084764X8 Or  1 8 1  BE  rMJ80O»BK8 14B 
■  ••04B7B741U  rvt  848001  4M>>  B8''II>1K  (»Br>  IGVBIJEBttBr  416UBC7  J4MBOr4  81B>  3Jt4JBOOr  SKU  tl  * 

l8804»?BC8sa8*?0«8070iaeru$rlOD44Mrr  >8E80rMr«rttOU80lE|a80KOIBr)08J«OOMK814A 
IM04B7CB41B  JrefM004«M8M8CI01D«88r*»8E80Kr8rBr  l»fGB870«H80ir  itBr  l?8J»OOMKBJ4< 

Inertial  String 

I0004D2DO$S87FF$A8022$BBFFA$C8021$DB FF3SE80F4  SFBF33 


-I - 1  I - 1 

I  I 

I  I  + - I3M  data  packet  (less  CR/LFl 

I  + - stamp  of  packet  in  millisecond 

-  - - Packet  type  ‘I'  -  I3M 


The  Inertial  string  is  broken  down  above.  All  the 
data  is  provided  in  ASCII  form,  but  represents 
a  Hexadecimal  number.  It  begins  with  a  string 
identifier  (I)  followed  by  a  4  Byte  timestamp  where 
each  Least  Significant  Bit  (LSB)  -  1  millisecond 
from  the  power  up  of  the  VDM.  The  timestamp 
is  in  unsigned  hexadecimal  format.  For  example, 
00028DFB  would  equal  167,419  milliseconds.  The 
timestamp  is  followed  by  1 2  packets  of  data  that 
provide  the  raw  inertial  data.  Each  packet  begins 
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with  a  start  character  ($)  and  a  packet  identifier  2 
Bytes  of  measurement  data  will  follow  the  packet 
identifier.  The  measurement  data  is  in  2s  compli¬ 
ment  format  as  well  as  a  New  Data  and  Error  indi¬ 
cator.  The  message  format  for  the  inertial  packet 
can  be  seen  in  Figure  1.  The  message  format  for 
the  temperature  packet  can  be  seen  in  Figure  2. 


Inertial  Packet  Format 

Bit  Position 

15 

15 

13|  12|  ll|  10|  9|  8| 7|  6|  5|4|  3|  2|  l|  0 

New  Data 

Error 

14-bit  Measurement  in  2's 

Indicator 

Indicator 

Compliment  Format 

Figure  1:  Inertial  Packet  Message  Format 


Temperature  Packet  Format 

Bit  Position 

15 

15 

13 

12 

ll|  10 1  9|  S|  7|  6|  5|4 1  3|  2|  1 1  0 

New  Data 

Indicator 

Error 

Indicator 

X 

X 

12-bit  Measurement  in  2’s 

Compliment  Format 

Figure  2:  Temperature  Packet  Message  Format 


To  convert  the  data  into  real  world  values  the  con¬ 
version  scalars  in  Figure  3  need  to  be  used.  Some 
example  conversions  follow. 


Data  Type 

Scale 

Note 

Gyroscope 

0.05 

"/s/LSB 

Accelerometer 

3.33 

mg/lSB 

Magnetometer 

0.5 

mgauss/LSB 

Temperature 

0.14 

"C/LSB 

25°C  =  0x0000 

Supply 

2.42 

mV/LSB 

Analog 

0.81 

mV/LSB 

Figure  3:  Conversion  Scalars  for  Inertial  String 


Sample  Conversions: 

IBB 209  =  -178.75  Ys 
IE80F2  =  0.806  g 
IH80BC  =  0.094  gauss 
$J800D  =  26.82  °C 
$S87FE  =  4.951V 
I1BF30  =  -0.1  gauss 
10004D295  =  5.27  minutes 


INERTIAL  STRING 

Byte 

Data 

Data  Description 

0 

i 

INS  Identifier 

1-8 

xxxxxxxx 

Time  Stamp  in  milliseconds  from  power  up 

9 

$ 

Packet  Separator 

10 

s 

Supply  Voltage  Identifier 

11-14 

xxxx 

LSB  14  bits,  2's  Compliment 

15 

$ 

Packet  Separator 

16 

A 

X-Axis  Gyroscope  Identifier 

17-20 

xxxx 

LSB  14  bits,  2's  Compliment 

21 

s 

Packet  Separator 

22 

B 

Y-Axis  Gyroscope  Identifier 

23-26 

xxxx 

LSB  14  bits,  2’s  Compliment 

27 

$ 

Packet  Separator 

28 

c 

Z-Axis  Gyroscope  Identifier 

29-32 

xxxx 

LSB  14  bits,  2's  Compliment 

33 

$ 

Packet  Separator 

34 

D 

X-Axis  Accelerometer  Identifier 

35-38 

xxxx 

LSB  14  bits,  2's  Compliment 

39 

$ 

Packet  Separator 

40 

E 

Y-Axis  Accelerometer  Identifier 

41-44 

xxxx 

LSB  14  bits,  2's  Compliment 

45 

$ 

Packet  Separator 

46 

F 

Z-Axis  Accelerometer  Identifier 

47-50 

xxxx 

LSB  14  bits,  2's  Compliment 

51 

$ 

Packet  Separator 

52 

G 

X-Axis  Magnetometer  Identifier 

53-56 

xxxx 

LSB  14  bits,  2's  Compliment 

57 

$ 

Packet  Separator 

58 

H 

Y-Axis  Magnetometer  Identifier 

59-62 

xxxx 

LSB  14  bits,  2's  Compliment 

63 

$ 

Packet  Separator 

64 

1 

Z-Axis  Magnetometer  Identifier 

65-68 

xxxx 

LSB  14  bits,  2's  Compliment 

69 

$ 

Packet  Separator 

70 

J 

Temperature  Identifier 

71-74 

xxxx 

LSB  12  bits,  2's  Compliment 

75 

$ 

Packet  Separator 

76 

K 

Analog  Channel  Identifier 

77-80 

xxxx 

LSB  12  bits,  2's  Compliment 

81 

CR 

Carriage  Return 

82 

LF 

Line  Feed 

Figure  4:  Inertial  String  Identifier 
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GPS  String 


VDM  Axes  Orientation 


C0001D255Co>NMEAtCPCCA,190050.00,'l213.92259,N,083'»'l  .51152, 

-I - II - 1 

1  !  1 

♦ - GPS  memgR  (GGA) 

|  ♦ - -Time  stamp  of  packet  in  milliseconds 

* - Par l«t  type  'G’-GPS 


The  GPS  string  is  broken  down  in  Figure  5.  It  is 
the  Global  Positioning  System  Fix  Data  (GGA) 
string  that  provides  3D  location  and  accuracy 
data.  It  is  part  of  the  National  Marine  Electron¬ 
ics  Association  (NMEA)  protocol  standard.  All 
the  data  is  provided  in  ASCII  format.  It  begins 
with  a  string  identifier  (G)  followed  by  a  4  Byte 
timestamp  where  each  Least  Significant  Bit  (LSB) 
=  1  millisecond  from  the  power  up  of  the  VDM. 
Tlie  timestamp  is  in  unsigned  hexadecimal  format  . 
The  timestamp  is  followed  by  a  message  identifier 
(GotNMEA)  and  then  the  GGA  string  starting 
with  the  string  identifier  (SGPGGA). 


GPS  STRING 

Byte 

Data 

Data  Description 

o 

G 

GP5  Identifier 

1-8 

xxxxxxxx 

Time  Stamp  in  milliseconds  frem  power  up 

9-15 

GotNMEA 

Message  identifier 

16-21 

SGPGGA 

Message  identifier 

22 

Packet  Separator 

23-31 

hhmmss.ss 

Coordinated  Universal  Time  |UTC] 

32 

Packet  Separator 

33-42 

ddmm.mmmmm 

Latitude,  Degrees  ♦  minutes 

43 

Packet  Separator 

44 

N/S 

North/South  indicator 

45 

Packet  Sepaiatoi 

46-56 

dddmm.inmmmm 

longitude.  Degrees  ♦  minutes 

57 

Packet  separator 

58 

E/W 

(ast/West  Indicator 

59 

Packet  Separator 

60 

X 

Position  Fix  Status  Indicator 

61 

Packet  Separator 

62,63 

XX 

Satellites  Used.  Range  0  to  12 

64 

Packet  Separator 

65-68 

Horizontal  Dilution  of  Precision 

69 

Packet  Separator 

70-74 

XXX. X 

Mean  Sea  Level  (MSI)  Altitude 

75 

Packet  Separator 

76 

M 

units.  Meters 

77 

Packet  Separator 

78-81 

XX. X 

Geoid  Separation 

82 

Packet  Separator 

83 

M 

Units,  Meters 

84 

Packet  Separator 

85 

empty  field 

Time  Between  Differential  Corrections 

86 

Packet  Separator 

87 

empty  field 

Differential  Reference  Station  ID 

88-90 

*xx 

Checksum 

91 

CR 

Carnage  Return 

92 

17 

line  Feed 

Figure  5:  GPS  String  Identifier 


The  VDM  axes  orientation  can  be  seen  Figure 
6.  When  it  is  placed  inside  the  Pelican  Case  the 
orientation  changes  and  can  be  seen  in  Figure  7. 


z+ 

V 


Figure  6:  VDM  Axes  Orientation 


Figure  7:  Axes  Orientation  of  the  VDM  in  Pelican 
Case 
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Vehicle  Dynamic  Monitor  (VDM) 
Software  Instruction 


Step-by-step  guide  to  using  the 
VDM  Analysis  software 

1.  Open  the  VDM  Analysis  software. 

Navigate  to  the  location  of  the  VDM 

Analysis  software  and  run  the  program. 

2.  Load  the  configuration  file. 

a)  Click  the  “Load  Ini... '’button. 

b)  Navigate  to  the  location  of  the  “con 
fig.ini”  that  corresponds  to  the  VDM 
and  click  “Open”.  The  default  file  can 
be  found  in  the  storage  location  of  the 
“VDM  Analysis”  software. 

3.  Load  the  data  fi  le  that  was  col  lected  by 

the  VDM. 

a)  Click  die  “Load  Data ...”  button. 

b)  Navigate  to  the  location  ol  the  “LOG_ 
xxxx.VDM”that  was  collected  by  the 
VDM  and  click  “Open”. 

4.  Select  the  forward  axis  of  the  VDM. 

a)  This  is  determined  by  how  the  VDM 
was  mounted  on  the  vehicle  during  data 
collection.  Use  the  visual  indicator  to 
determine  the  lorward  axis. 


b)  Select  the  “X”,  “Y’\  or  “Z”  forward  axis. 
Then  select  if  the  negative  axis  is 
poin Ling  lorward.  Note:  In  the 
diagram,  the  end  with  the  arrow  is  the 
positive  direction. 

5.  Determine  if  the  output  data  needs  to 
be  forced  to  the  GPS  data.  (Optional) 

The  “Force  to  GPS” option  will  use  every 
GPS  position  update  to  help  increase  the 
accuracy  of  the  inertial  data.  It  will  alter 
the  inertial  data  algorithms  to  force  the 
output  to  the  absolute  GPS  position.  Tn 
oilier  words,  it  will  make  sure  lliat  die 
inertial  data  that  is  collected  between  two 
GPS  points  starts  at  die  first  GPS  point 
and  will  cud  at  the  second  GPS  point.  Il 
this  option  is  not  selected  then  the  inertial 
data  will  have  the  potential  of  ending  at  a 
different  position  than  the  GPS  data 

6.  Process  the  data. 

a)  Click  on  the  “Process  Data”  button  and 
wait  lor  the  VDM  Analysis  software  to 
perform  the  calculations.  'Ihe  following 
screen  will  be  displayed. 
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b)  When  the  processing  is  complete  the 
arrow  will  have  stopped  moving  and  the 
software  screen  will  look  as  follows. 


7.  Save  the  processed  data. 

a)  Click  the  “Save  Processed  Data..." 
button. 

b)  Name  the  file  as  desired  and  navigate  to 
the  location  where  you  want  to  store  it 
on  the  hard  drive. 

8.  Display  the  path  on  Google  Earth 

(Optional) 

a)  Click  the  “Display  Path  in  Google 
Earth" button  and  the  software  will 
present  the  path  in  Google  Earth.  The 
red  line  is  the  GPS  path  and  the  blue 
line  represents  the  inertial  data. 

b)  Note:  Google  Earth  must  be  installed 
for  this  function  to  work. 


Explanation  of  the  Processed  Data  File 

A  sample  output  file  can  be  seen  on  the  next  page 
An  explanation  of  the  file  data  follow: 

Time:  The  number  of  seconds  from  12:00  Am., 
Coordinated  Universal  Time  (UTC) 


UTC:  Coordinated  Universal  Time  in  hours  (first 
2  digits),  minutes  (second  2  digits),  seconds  (third 
2  digits),  milliseconds  (last  3  digits) 

Count:  the  number  of  samples  that  were  averaged 
into  the  data  point 

Lat:  Latitude  in  degrees 

Lon:  Longitude  in  degrees 

Ax:  Acceleration  in  the  x-axis  (in/s2) 

Ay:  Acceleration  in  the  y  axis  (m/s2) 

Az:  Acceleration  in  the  z  axis  (m/s2) 

Mx:  X-axis  magnetometer,  not  scaled  at  this  time 

My:  Y-axis  magnetometer,  not  scaled  at  this  rime 

Mi:  Z  -axis  magnetometer,  not  scaled  at  this  time 

Gx:  Angular  rare  in  the  x-axis  (m/s) 

Gy:  Angular  rate  in  the  y-axis  (m/s) 

Gz:  Angular  rate  in  the  z-axis  (m/s) 

RawA:  Raw  data  from  the  accelerometers  [X  axis, 
Y-axis,  Z-axis] 

RawM:  Raw  data  from  the  magnetometers  [X- 
axis,  Y-axis,  Z-axis] 

RawG:  Raw  data  from  the  gyroscopes  [X-axis, 
Y-axis,  Z-axis] 

GCA  string:  If  a  GPS  signal  was  captured  during 
the  data  point  development  then  the  GGA  string 
has  been  attached  for  information  on  the  signal 
quality 


m 

50 

O 

o 

m 

73 


73 

I 

H 

N> 

I 

P 


Time= 

53071.002  UTC= 

144431.002  Count= 

1  Lat=  39.301023  Lon= 

-96.923883  Ax= 

-1.015082  Ay= 

0.775218  Az= 

-13.006616  Mx= 

0.052058  My= 

0.069461  Mz= 

0.254243  Gx= 

-0.033306  Gy= 

0.032852  Gz= 

-0.245014 

Time= 

53071.11  UTC= 

144431.11  Count= 

6  Lat=  39.301023  Lon= 

-96.923883  Ax= 

-1.029255  Ay= 

0.948112  Az= 

-11.626783  Mx= 

0.052407  My= 

0.068247  Mz= 

0.253036  Gx= 

-0.0342  Gy= 

0.035356  Gz= 

-0.252446 

Time= 

53071.215  UTC= 

144431.215  Count= 

12  Lat=  39.301021  Lon= 

-96.923883  Ax= 

-0.624841  Ay= 

0.203648  Az= 

-8.522428  Mx= 

0.053496  My= 

0.067085  Mz= 

0.251147  Gx= 

-0.032507  Gy= 

0.037859  Gz= 

-0.268015 

Time= 

53071.325  UTC= 

144431.325  Count= 

11  Lat=  39.301021  Lon= 

-96.923883  Ax= 

-1.15627  Ay= 

-0.687237  A z= 

-7.443141  Mx= 

0.055394  My= 

0.068778  Mz= 

0.252711  Gx= 

-0.028519  Gy= 

0.032889  Gz= 

-0.280817 

Time= 

53071.435  UTC= 

144431.435  Count= 

11  Lat=  39.301023  Lon= 

-96.923883  Ax= 

-1.41662  Ay= 

0.193314  Az= 

-11.019666  Mx= 

0.056215  My= 

0.068712  Mz= 

0.254064  Gx= 

-0.03299  Gy= 

0.031634  Gz= 

-0.293991 

Time= 

53071.545  UTC= 

144431.545  Count= 

11  Lat=  39.301024  Lon= 

-96.923882  Ax= 

-1.441775  Ay= 

1.116929  Az= 

-11.98369  Mx= 

0.056074  My= 

0.067268  Mz= 

0.252355  Gx= 

-0.040016  Gy= 

0.037623  Gz= 

-0.306112 

Time= 

53071.645  UTC= 

144431.645  Count= 

10  Lat=  39.301024  Lon= 

-96.923882  Ax= 

-0.551895  Ay= 

0.564345  Az= 

-9.697136  Mx= 

0.055387  My= 

0.06707  Mz= 

0.251444  Gx= 

-0.039632  Gy= 

0.043336  Gz= 

-0.316323 

Time= 

53071.746  UTC= 

144431.746  Count= 

10  Lat=  39.301024  Lon= 

-96.923882  Ax= 

-0.804421  Ay= 

-0.432352  Az= 

-7.095303  Mx= 

0.054793  My= 

0.06802  Mz= 

0.254477  Gx= 

-0.034831  Gy= 

0.041001  Gz= 

-0.326214 

Time= 

53071.859  UTC= 

144431.859  Count= 

10  Lat=  39.301025  Lon= 

-96.923882  Ax= 

-1.118308  Ay= 

-0.629448  Az= 

-8.853902  Mx= 

0.055599  My= 

0.068196  Mz= 

0.257629  Gx= 

-0.034919  Gy= 

0.040347  Gz= 

-0.336729 

Time= 

53071.965  UTC= 

144431.965  Count= 

12  Lat=  39.301026  Lon= 

-96.923881  Ax= 

-1.121329  Ay= 

0.617131  Az= 

-12.49672  Mx= 

0.054747  My= 

0.065918  Mz= 

0.255979  Gx= 

-0.042551  Gy= 

0.045597  Gz= 

-0.348113 

Time= 

53072.066  UTC= 

144432.066  Count= 

10  Lat=  39.301027  Lon= 

-96.923881  Ax= 

-1.02871  Ay= 

0.968229  Az= 

-10.8295  Mx= 

0.054103  My= 

0.062805  Mz= 

0.252941  Gx= 

-0.048888  Gy= 

0.049828  Gz= 

-0.358293 

Time= 

53072.175  UTC= 

144432.175  Count= 

11  Lat=  39.301027  Lon= 

-96.923881  Ax= 

-0.569014  Ay= 

0.018745  Az= 

-7.866904  Mx= 

0.05354  My= 

0.061258  Mz= 

0.252083  Gx= 

-0.046158  Gy= 

0.05025  Gz= 

-0.368344 

Time= 

53072.276  UTC= 

144432.276  Count= 

10  Lat=  39.301028  Lon= 

-96.92388  Ax= 

-1.061415  Ay= 

-0.805948  Az= 

-7.804015  Mx= 

0.055682  My= 

0.063022  Mz= 

0.252084  Gx= 

-0.040757  Gy= 

0.0474  Gz= 

-0.378805 

RawA=[ 

106830 

-159157 

5689065  ]RawM=[ 

-79412 

574049  -643573  ]RawG=[ 

-99657 

216245 

-484066  ]  GGA= 

RawA=[ 

180309 

-156579 

4903759  ]RawM=[ 

-78800 

579149  -639807  ]RawG=[ 

-9255 

238861 

-439304  ]  GGA= 

GOOOOCADOGotNMEA:  GPGGA,144431.00, 3918.06126, N, 09655.43306, W,l, 7, 1.32, 413.6, M, -27.7, M„ 

RawA=[ 

224169 

303017 

3319562  ]RawM=[ 

-75645 

570085  -644702  ]RawG=[ 

-6980 

336421 

-462734  ]  GGA= 

RawA=[ 

-247413 

491854 

3961497  ]RawM=[ 

-68532 

570745  -648806  ]RawG=[ 

-74836 

287678 

-478886  ]  GGA= 

RawA=[ 

-391285 

-58688 

4680502  ]RawM=[ 

-70862 

578409  -646270  ]RawG=[ 

-116493 

204942 

-449401]  GGA= 

RawA=[ 

61851 

-395199 

5604484  ]RawM=[ 

-72901 

574249  -637838  ]RawG=[ 

-53383 

194747 

-449335  ]  GGA= 

RawA=[ 

116494 

-3588 

3891546  ]RawM=[ 

-75637 

572178  -649198  ]RawG=[ 

19448 

299815 

-442511  ]  GGA= 

RawA=[ 

-63158 

487965 

2706045  JRawM=[ 

-62993 

573142  -661874  ]RawG=[ 

-36557 

285014 

-446919  ]  GGA= 

RawA=[ 

69103 

236505 

4891838  )RawM=[ 

-72695 

580509  -654329  ]RawG=[ 

-122212 

193672 

-454645  ]  GGA= 

RawA=[ 

46879 

-270021 

5298544  ]RawM=[ 

-70779 

586526  -644245  ]RawG=[ 

-134239 

213369 

-441710  ]  GGA= 

RawA=[ 

171294 

-199011 

4401135  ]RawM=[ 

-73448 

592523  -643062  ]RawG=[ 

-33718 

249125 

-444658  ]  GGA= 

RawA=[ 

270527 

598197 

3378515  ]RawM=[ 

-71520 

583192  -645127  ]RawG=[ 

16201 

314629 

-443029  ]  GGA= 

RawA=[ 

-230074 

620269 

4044364  ]RawM=[ 

-72284 

573846  -641126  ]RawG=[ 

-59823 

281176 

-457929  ]  GGA= 
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